Jul 16 10:54:36 devstack cinder-volume[75856]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 16 10:54:36 devstack cinder-volume[75856]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 10:54:36 devstack cinder-volume[75856]: we strongly recommend against using it for new projects. Jul 16 10:54:36 devstack cinder-volume[75856]: If you are already using Eventlet, we recommend migrating to a different Jul 16 10:54:36 devstack cinder-volume[75856]: framework. For more detail see Jul 16 10:54:36 devstack cinder-volume[75856]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 10:54:36 devstack cinder-volume[75856]: import eventlet # noqa Jul 16 10:54:39 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 10:54:39 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 10:54:39 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 10:54:40 devstack cinder-volume[75856]: INFO dbcounter [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Registered counter for database cinder Jul 16 10:54:40 devstack cinder-volume[75856]: DEBUG oslo_db.sqlalchemy.engines [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75856) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG dbcounter [-] [75856] Writer thread running {{(pid=75856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 10:54:41 devstack cinder-volume[75856]: INFO cinder.rpc [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 16 10:54:41 devstack cinder-volume[75856]: INFO cinder.rpc [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_db.sqlalchemy.engines [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75856) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:54:41 devstack cinder-volume[75856]: INFO cinder.volume.manager [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Determined volume DB was empty at startup. Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG cinder.volume.manager [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75856) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 16 10:54:41 devstack cinder-volume[75856]: INFO cinder.volume.manager [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 16 10:54:41 devstack cinder-volume[75856]: WARNING stevedore.named [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 10:54:41 devstack cinder-volume[75856]: WARNING castellan.key_manager [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 10:54:41 devstack cinder-volume[75856]: WARNING cinder.keymgr.conf_key_mgr [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG cinder.volume.drivers.lvm [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75856) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_concurrency.processutils [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_concurrency.processutils [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] CMD "cinder-rtstool verify" returned: 0 in 0.380s {{(pid=75856) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_db.sqlalchemy.engines [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75856) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:54:41 devstack cinder-volume[75856]: INFO cinder.rpc [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 16 10:54:41 devstack cinder-volume[75856]: INFO cinder.rpc [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 16 10:54:41 devstack cinder-volume[75856]: WARNING stevedore.named [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 10:54:41 devstack cinder-volume[75856]: WARNING castellan.key_manager [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 10:54:41 devstack cinder-volume[75856]: INFO cinder.volume.manager [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_db.sqlalchemy.engines [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75856) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:54:41 devstack cinder-volume[75856]: INFO oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Starting 1 workers Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Started child 76006 {{(pid=75856) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Full set of CONF: {{(pid=75856) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] ******************************************************************************** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Configuration options gathered from: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] ================================================================================ {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] allow_availability_zone_fallback = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] allow_compression_on_image_upload = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] allowed_direct_url_schemes = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] api_rate_limit = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] auth_strategy = keystone {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] az_cache_duration = 3600 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_availability_zone = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_host = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_stats_polling_interval = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backup_api_class = cinder.backup.api.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backup_name_template = backup-%s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backup_use_same_host = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backup_use_temp_snapshot = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] chap_password = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[76006]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] chap_username = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cinder_internal_tenant_project_id = 9b5d4208cf92418182656548d0ddbc27 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cinder_internal_tenant_user_id = 822304e675dd4ab4a083b7c74ab0398f {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cloned_volume_same_az = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cluster = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] compression_format = gzip {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] compute_api_class = cinder.compute.nova.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] config_dir = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] config_source = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] control_exchange = openstack {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] debug = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] default_availability_zone = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] default_group_type = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] default_volume_type = lvmdriver-1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] disk_geometry = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] driver_client_cert = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] driver_client_cert_key = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] driver_data_namespace = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] driver_ssl_cert_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] driver_ssl_cert_verify = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] driver_use_ssl = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] enable_force_upload = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] enable_new_services = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] enable_unsupported_driver = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] enforce_multipath_for_image_xfer = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] filter_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance_api_insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance_api_servers = ['http://192.168.122.104/image'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance_api_ssl_compression = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance_ca_certificates_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance_catalog_info = image:glance:publicURL {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance_certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance_keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance_num_retries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance_request_timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] goodness_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] graceful_shutdown_timeout = 5 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] group_api_class = cinder.group.api.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] host = devstack {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] image_compress_on_upload = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] image_conversion_address_space_limit = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] image_conversion_cpu_limit = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] image_conversion_disable = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] image_upload_use_cinder_backend = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] image_upload_use_internal_tenant = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] image_volume_cache_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] image_volume_cache_max_count = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] image_volume_cache_max_size_gb = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] init_host_max_objects_retrieval = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] instance_format = [instance: %(uuid)s] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] iscsi_target_flags = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] iscsi_write_cache = on {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] iser_helper = tgtadm {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] iser_ip_address = 192.168.122.104 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] iser_port = 3260 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] log_color = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] log_config_append = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] log_dir = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] log_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] log_options = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] log_rotate_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] log_rotate_interval_type = days {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] log_rotation_type = none {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] max_age = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] max_logfile_count = 30 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] max_logfile_size_mb = 200 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] max_over_subscription_ratio = 20.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] message_reap_interval = 86400 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] message_ttl = 2592000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] migration_create_volume_timeout_secs = 300 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] monkey_patch = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] monkey_patch_modules = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] my_ip = 192.168.122.104 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] no_snapshot_gb_quota = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] num_iser_scan_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] num_shell_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] num_volume_device_scan_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] nvmeof_conn_info_version = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] nvmet_ns_id = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] nvmet_port_id = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] osapi_max_limit = 1000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] osapi_volume_ext_list = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] osapi_volume_listen_port = 8776 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] osapi_volume_use_ssl = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] osapi_volume_workers = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] per_volume_size_limit = -1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] periodic_fuzzy_delay = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] periodic_interval = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] public_endpoint = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] publish_errors = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] quota_backup_gigabytes = 1000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] quota_backups = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] quota_gigabytes = 1000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] quota_groups = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] quota_snapshots = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] quota_volumes = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] rate_limit_burst = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] rate_limit_except_level = CRITICAL {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] rate_limit_interval = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] reinit_driver_count = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] replication_device = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] report_discard_supported = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] report_interval = 120 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] reservation_clean_interval = 86400 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] reservation_expire = 86400 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] reserved_image_namespaces = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] reserved_percentage = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] rpc_response_timeout = 120 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] run_external_periodic_tasks = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] scst_target_driver = iscsi {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] scst_target_iqn_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] service_down_time = 720 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] shell_completion = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] snapshot_name_template = snapshot-%s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] snapshot_same_host = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] split_loggers = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] state_path = /opt/stack/data/cinder {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] storage_availability_zone = nova {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] storage_protocol = iSCSI {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] syslog_log_facility = LOG_USER {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] target_helper = lioadm {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] target_ip_address = 192.168.122.104 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] target_port = 3260 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] target_protocol = iscsi {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] target_secondary_ip_addresses = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] trace_flags = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] transport_url = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] until_refresh = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] use_chap_auth = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] use_default_quota_class = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] use_journal = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] use_json = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] use_multipath_for_image_xfer = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] use_stderr = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] use_syslog = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] verify_glance_signatures = enabled {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_api_class = cinder.volume.api.API {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_backend_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_clear = zero {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_clear_ionice = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_clear_size = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_copy_bps_limit = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_dd_blocksize = 1M {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_name_template = volume-%s {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_service_inithost_offload = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volume_usage_audit_period = month {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] zoning_mode = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_concurrency.disable_process_locking = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.auth_section = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.auth_type = password {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.auth_version = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.cache = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.include_service_catalog = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.interface = public {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_password = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[76006]: INFO cinder.volume.manager [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcache_username = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.region_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.service_type = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.104/identity {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.backend = dogpile.cache.null {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.backend_argument = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.backend_expiration_time = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.config_prefix = cache.oslo {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.debug_cache_backend = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.enable_retry_client = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.enable_socket_keepalive = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.expiration_time = 600 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.hashclient_retry_attempts = 2 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.memcache_dead_retry = 300 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.memcache_pool_maxsize = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.memcache_sasl_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.password = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.proxies = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.redis_db = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.redis_server = localhost:6379 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.retry_attempts = 2 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.retry_delay = 0.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.socket_keepalive_count = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.socket_keepalive_idle = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.socket_keepalive_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.socket_timeout = 1.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.tls_allowed_ciphers = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.tls_cafile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.tls_certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.tls_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.tls_keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cache.username = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] coordination.backend_url = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.asyncio_connection = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.asyncio_slave_connection = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.backend = sqlalchemy {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.connection = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.connection_debug = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.connection_parameters = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.connection_recycle_time = 3600 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.connection_trace = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.db_inc_retry_interval = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.db_max_retries = 20 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.db_max_retry_interval = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.db_retry_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.max_overflow = 50 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.max_pool_size = 5 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.max_retries = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.mysql_wsrep_sync_wait = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.pool_timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.retry_interval = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.slave_connection = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.sqlite_synchronous = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.synchronous_reader = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] database.use_db_reconnect = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler.connection_string = messaging:// {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler.enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler.es_doc_type = notification {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler.es_scroll_size = 10000 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler.es_scroll_time = 2m {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler.filter_error_trace = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler.hmac_keys = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler.sentinel_service_name = mymaster {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler.socket_timeout = 0.1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler.trace_requests = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler.trace_sqlalchemy = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler_jaeger.process_tags = {} {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler_jaeger.service_name_prefix = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] profiler_otlp.service_name_prefix = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_policy.enforce_new_defaults = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_policy.enforce_scope = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_policy.policy_default_rule = default {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_policy.policy_file = policy.yaml {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] privsep_osbrick.group = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] privsep_osbrick.helper_command = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] privsep_osbrick.user = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cinder_sys_admin.group = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cinder_sys_admin.helper_command = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] cinder_sys_admin.user = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] service_user.auth_section = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] service_user.auth_type = password {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] service_user.cafile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] service_user.certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] service_user.collect_timing = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] service_user.insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] service_user.keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] service_user.send_service_user_token = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] service_user.split_loggers = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] service_user.timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance.auth_section = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance.auth_type = password {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance.certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance.collect_timing = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance.insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance.keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance.region_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance.split_loggers = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] glance.timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.backend_availability_zone = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:41 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.chap_password = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.chap_username = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.disk_geometry = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.driver_client_cert = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.driver_client_cert_key = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.driver_data_namespace = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.driver_use_ssl = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.extra_capabilities = {} {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.filter_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.goodness_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.iscsi_target_flags = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.iscsi_write_cache = on {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.iser_helper = tgtadm {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.iser_ip_address = 192.168.122.104 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.iser_port = 3260 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.lvm_share_target = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.lvm_type = auto {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.num_shell_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.replication_device = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.report_discard_supported = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.reserved_percentage = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.target_helper = tgtadm {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.target_ip_address = 192.168.122.104 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.target_port = 3260 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.target_protocol = iscsi {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.trace_flags = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.unique_fqdn_network = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.use_chap_auth = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.volume_backend_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.volume_clear = zero {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.volume_clear_ionice = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.volume_clear_size = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_reports.file_event_handler = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_reports.log_dir = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.backend_host = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.chap_password = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.chap_username = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.disk_geometry = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.driver_client_cert = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.extra_capabilities = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.filter_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.goodness_function = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.iser_helper = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.iser_ip_address = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.iser_port = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.lvm_share_target = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.lvm_type = auto {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.num_shell_tries = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.replication_device = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.report_discard_supported = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.reserved_percentage = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.scst_target_driver = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.storage_protocol = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.target_helper = lioadm {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.target_ip_address = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.target_port = 3260 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.trace_flags = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.use_chap_auth = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.volume_clear = zero {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.volume_clear_size = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] lvmdriver-1.volumes_dir = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.ssl = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_notifications.driver = [] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_notifications.retry = -1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] key_manager.fixed_key = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.barbican_api_version = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.barbican_endpoint = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.barbican_endpoint_type = public {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.barbican_region_name = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.cafile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.collect_timing = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.number_of_retries = 60 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.retry_delay = 1 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.send_service_user_token = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.split_loggers = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.verify_ssl = True {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican.verify_ssl_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican_service_user.auth_section = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican_service_user.auth_type = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican_service_user.cafile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican_service_user.certfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican_service_user.collect_timing = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican_service_user.insecure = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican_service_user.keyfile = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican_service_user.split_loggers = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] barbican_service_user.timeout = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.approle_role_id = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.approle_secret_id = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.auth_method = approle {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.auth_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.kv_mountpoint = secret {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.kv_path = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.kv_version = 2 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.namespace = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.root_token_id = **** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.ssl_ca_crt_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.timeout = 60.0 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.token_file = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.token_role = None {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.use_ssl = False {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:54:42 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] ******************************************************************************** {{(pid=75856) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 16 10:54:42 devstack sudo[76010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 16 10:54:42 devstack sudo[76010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:42 devstack sudo[76010]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:42 devstack sudo[76082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:54:42 devstack sudo[76082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:42 devstack sudo[76082]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.246s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 10:54:42 devstack cinder-volume[76006]: INFO cinder.brick.local_dev.lvm [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:42 devstack sudo[76192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 10:54:42 devstack sudo[76192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:42 devstack sudo[76192]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG cinder.brick.local_dev.lvm [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76006) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 16 10:54:42 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:42 devstack sudo[76279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:54:42 devstack sudo[76279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:43 devstack sudo[76279]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:43 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.518s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:43 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:43 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:43 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:43 devstack sudo[76462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:54:43 devstack sudo[76462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:43 devstack sudo[76462]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:43 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:43 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:43 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:43 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:43 devstack sudo[76541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 16 10:54:43 devstack sudo[76541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:43 devstack sudo[76541]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:43 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.286s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:43 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:43 devstack sudo[76619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 10:54:43 devstack sudo[76619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:44 devstack sudo[76619]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:44 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:44 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:44 devstack sudo[76623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 10:54:44 devstack sudo[76623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:44 devstack sudo[76623]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:44 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:44 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:44 devstack sudo[76705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:54:44 devstack sudo[76705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:44 devstack sudo[76705]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:44 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:44 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:44 devstack sudo[76708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:54:44 devstack sudo[76708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:45 devstack sudo[76708]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:45 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:45 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:45 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:45 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:45 devstack sudo[76752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:54:45 devstack sudo[76752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:45 devstack sudo[76752]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:45 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:45 devstack cinder-volume[76006]: INFO cinder.volume.drivers.lvm [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 16 10:54:45 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:45 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:45 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:45 devstack sudo[76805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:54:45 devstack sudo[76805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:45 devstack sudo[76805]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:45 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:45 devstack cinder-volume[76006]: DEBUG cinder.volume.drivers.lvm [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Updating volume stats {{(pid=76006) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 10:54:45 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:45 devstack sudo[76808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 10:54:45 devstack sudo[76808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:46 devstack sudo[76808]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:46 devstack sudo[76811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:54:46 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:46 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:46 devstack sudo[76815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:54:46 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:46 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:46 devstack sudo[76821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:54:46 devstack sudo[76821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:46 devstack sudo[76821]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:46 devstack cinder-volume[76006]: INFO cinder.volume.driver [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Driver hasn't implemented _init_vendor_properties() Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG cinder.volume.driver [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76006) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG oslo_db.sqlalchemy.engines [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76006) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG dbcounter [-] [76006] Writer thread running {{(pid=76006) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG cinder.db.api [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Building query based on filter {{(pid=76006) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG cinder.image.image_utils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76006) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 16 10:54:46 devstack cinder-volume[76006]: INFO cinder.keymgr.migration [None req-244dc281-bbdd-4012-8c33-619eebd63e17 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG cinder.volume.drivers.lvm [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Updating volume stats {{(pid=76006) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 10:54:46 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:47 devstack sudo[76824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 10:54:47 devstack sudo[76824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:47 devstack sudo[76824]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:47 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:47 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:47 devstack sudo[76827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:54:47 devstack sudo[76827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:47 devstack sudo[76827]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:47 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:47 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:47 devstack sudo[76838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:54:47 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:47 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:47 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:47 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:47 devstack sudo[76841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:54:47 devstack sudo[76841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:47 devstack sudo[76841]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:47 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:47 devstack cinder-volume[76006]: DEBUG cinder.manager [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Notifying Schedulers of capabilities ... {{(pid=76006) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 10:54:48 devstack cinder-volume[76006]: INFO cinder.volume.manager [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Driver initialization completed successfully. Jul 16 10:54:48 devstack cinder-volume[76006]: INFO cinder.manager [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Initiating service 2 cleanup Jul 16 10:54:48 devstack cinder-volume[76006]: INFO cinder.manager [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Service 2 cleanup completed. Jul 16 10:54:48 devstack cinder-volume[76006]: DEBUG cinder.service [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Creating RPC server for service cinder-volume {{(pid=76006) start /opt/stack/cinder/cinder/service.py:231}} Jul 16 10:54:48 devstack cinder-volume[76006]: DEBUG cinder.service [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76006) start /opt/stack/cinder/cinder/service.py:237}} Jul 16 10:54:48 devstack cinder-volume[76006]: INFO cinder.volume.manager [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 16 10:54:48 devstack cinder-volume[76006]: DEBUG cinder.volume.drivers.lvm [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Updating volume stats {{(pid=76006) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 10:54:48 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:48 devstack sudo[76845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 10:54:48 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:48 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:48 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:48 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:48 devstack sudo[76849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:54:48 devstack sudo[76849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:48 devstack sudo[76849]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:48 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:48 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:48 devstack sudo[76852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:54:48 devstack sudo[76852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:48 devstack sudo[76852]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:48 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.234s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:48 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:54:48 devstack sudo[76855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:54:48 devstack sudo[76855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:54:49 devstack sudo[76855]: pam_unix(sudo:session): session closed for user root Jul 16 10:54:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:54:49 devstack cinder-volume[76006]: INFO cinder.volume.manager [None req-5805d74f-8038-47b2-93f0-693f45f46fac None None] Driver post RPC initialization completed successfully. Jul 16 10:54:49 devstack cinder-volume[76006]: DEBUG oslo_service.periodic_task [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running periodic task VolumeManager._thread_info {{(pid=76006) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 10:54:49 devstack cinder-volume[76006]: DEBUG cinder.volume.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] thread count: 6 {{(pid=76006) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 10:54:49 devstack cinder-volume[76006]: DEBUG cinder.volume.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] thread info: [<_MainThread(MainThread, started 126226972061824)>, , , , , ] {{(pid=76006) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 10:54:51 devstack cinder-volume[75856]: DEBUG dbcounter [-] [75856] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75856) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 10:54:58 devstack cinder-volume[76006]: DEBUG dbcounter [-] [76006] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76006) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 10:54:59 devstack cinder-volume[76006]: DEBUG dbcounter [-] [76006] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76006) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 10:55:49 devstack cinder-volume[76006]: DEBUG oslo_service.periodic_task [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76006) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 10:55:49 devstack cinder-volume[76006]: DEBUG cinder.volume.drivers.lvm [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Updating volume stats {{(pid=76006) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 10:55:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:55:49 devstack sudo[79253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 10:55:49 devstack sudo[79253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:55:49 devstack sudo[79253]: pam_unix(sudo:session): session closed for user root Jul 16 10:55:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:55:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:55:49 devstack sudo[79256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:55:49 devstack sudo[79256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:55:49 devstack sudo[79256]: pam_unix(sudo:session): session closed for user root Jul 16 10:55:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:55:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:55:49 devstack sudo[79259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:55:49 devstack sudo[79259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:55:50 devstack sudo[79259]: pam_unix(sudo:session): session closed for user root Jul 16 10:55:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:55:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:55:50 devstack sudo[79262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:55:50 devstack sudo[79262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:55:50 devstack sudo[79262]: pam_unix(sudo:session): session closed for user root Jul 16 10:55:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:55:50 devstack cinder-volume[76006]: DEBUG cinder.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Notifying Schedulers of capabilities ... {{(pid=76006) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 10:55:50 devstack cinder-volume[76006]: DEBUG oslo_service.periodic_task [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running periodic task VolumeManager._thread_info {{(pid=76006) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 10:55:50 devstack cinder-volume[76006]: DEBUG cinder.volume.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] thread count: 6 {{(pid=76006) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 10:55:50 devstack cinder-volume[76006]: DEBUG cinder.volume.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] thread info: [<_MainThread(MainThread, started 126226972061824)>, , , , , ] {{(pid=76006) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 10:56:49 devstack cinder-volume[76006]: DEBUG oslo_service.periodic_task [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76006) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 10:56:49 devstack cinder-volume[76006]: DEBUG cinder.volume.drivers.lvm [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Updating volume stats {{(pid=76006) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 10:56:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:56:49 devstack sudo[82520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 10:56:49 devstack sudo[82520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:56:49 devstack sudo[82520]: pam_unix(sudo:session): session closed for user root Jul 16 10:56:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:56:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:56:49 devstack sudo[82523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:56:49 devstack sudo[82523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:56:49 devstack sudo[82523]: pam_unix(sudo:session): session closed for user root Jul 16 10:56:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:56:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:56:49 devstack sudo[82526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:56:49 devstack sudo[82526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:56:50 devstack sudo[82526]: pam_unix(sudo:session): session closed for user root Jul 16 10:56:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:56:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:56:50 devstack sudo[82529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:56:50 devstack sudo[82529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:56:50 devstack sudo[82529]: pam_unix(sudo:session): session closed for user root Jul 16 10:56:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:56:50 devstack cinder-volume[76006]: DEBUG cinder.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Notifying Schedulers of capabilities ... {{(pid=76006) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 10:56:50 devstack cinder-volume[76006]: DEBUG oslo_service.periodic_task [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running periodic task VolumeManager._thread_info {{(pid=76006) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 10:56:50 devstack cinder-volume[76006]: DEBUG cinder.volume.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] thread count: 6 {{(pid=76006) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 10:56:50 devstack cinder-volume[76006]: DEBUG cinder.volume.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] thread info: [<_MainThread(MainThread, started 126226972061824)>, , , , , ] {{(pid=76006) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 10:56:59 devstack cinder-volume[76006]: DEBUG dbcounter [-] [76006] Writing DB stats cinder:SELECT=1 {{(pid=76006) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 10:56:59 devstack cinder-volume[76006]: DEBUG dbcounter [-] [76006] Writing DB stats cinder:UPDATE=1 {{(pid=76006) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 10:57:49 devstack cinder-volume[76006]: DEBUG oslo_service.periodic_task [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76006) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 10:57:49 devstack cinder-volume[76006]: DEBUG cinder.volume.drivers.lvm [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Updating volume stats {{(pid=76006) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 10:57:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:57:49 devstack sudo[84386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 10:57:49 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:57:49 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root Jul 16 10:57:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:57:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:57:49 devstack sudo[84405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:57:49 devstack sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:57:49 devstack sudo[84405]: pam_unix(sudo:session): session closed for user root Jul 16 10:57:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:57:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:57:49 devstack sudo[84409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:57:49 devstack sudo[84409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:57:50 devstack sudo[84409]: pam_unix(sudo:session): session closed for user root Jul 16 10:57:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:57:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:57:50 devstack sudo[84413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:57:50 devstack sudo[84413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:57:50 devstack sudo[84413]: pam_unix(sudo:session): session closed for user root Jul 16 10:57:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:57:50 devstack cinder-volume[76006]: DEBUG cinder.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Notifying Schedulers of capabilities ... {{(pid=76006) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 10:58:49 devstack cinder-volume[76006]: DEBUG oslo_service.periodic_task [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76006) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 10:58:49 devstack cinder-volume[76006]: DEBUG cinder.volume.drivers.lvm [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Updating volume stats {{(pid=76006) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 10:58:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:58:49 devstack sudo[85713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 10:58:49 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:58:49 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root Jul 16 10:58:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:58:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:58:49 devstack sudo[85716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:58:49 devstack sudo[85716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:58:49 devstack sudo[85716]: pam_unix(sudo:session): session closed for user root Jul 16 10:58:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:58:49 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:58:49 devstack sudo[85720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 10:58:49 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:58:50 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root Jul 16 10:58:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:58:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:58:50 devstack sudo[85723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 10:58:50 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:58:50 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root Jul 16 10:58:50 devstack cinder-volume[76006]: DEBUG oslo_concurrency.processutils [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76006) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:58:50 devstack cinder-volume[76006]: DEBUG cinder.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Notifying Schedulers of capabilities ... {{(pid=76006) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 10:58:50 devstack cinder-volume[76006]: DEBUG oslo_service.periodic_task [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] Running periodic task VolumeManager._thread_info {{(pid=76006) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 10:58:50 devstack cinder-volume[76006]: DEBUG cinder.volume.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] thread count: 6 {{(pid=76006) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 10:58:50 devstack cinder-volume[76006]: DEBUG cinder.volume.manager [None req-0acf5260-0088-4f92-afff-f4139c7226b3 None None] thread info: [<_MainThread(MainThread, started 126226972061824)>, , , , , ] {{(pid=76006) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 10:58:59 devstack cinder-volume[76006]: DEBUG dbcounter [-] [76006] Writing DB stats cinder:SELECT=1 {{(pid=76006) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 10:58:59 devstack cinder-volume[76006]: DEBUG dbcounter [-] [76006] Writing DB stats cinder:UPDATE=1 {{(pid=76006) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 10:59:21 devstack cinder-volume[75856]: INFO oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Caught SIGTERM, stopping children Jul 16 10:59:21 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Acquiring lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 10:59:21 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Acquired lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 10:59:21 devstack cinder-volume[75856]: DEBUG oslo_concurrency.lockutils [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Releasing lock "singleton_lock" {{(pid=75856) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 10:59:21 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Stop services. {{(pid=75856) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 16 10:59:21 devstack cinder-volume[75856]: DEBUG oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Killing children. {{(pid=75856) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 16 10:59:21 devstack cinder-volume[75856]: INFO oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Waiting on 1 children to exit Jul 16 10:59:23 devstack cinder-volume[76006]: DEBUG oslo_concurrency.lockutils [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Acquiring lock "singleton_lock" {{(pid=76006) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 10:59:23 devstack cinder-volume[76006]: DEBUG oslo_concurrency.lockutils [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Acquired lock "singleton_lock" {{(pid=76006) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 10:59:23 devstack cinder-volume[76006]: DEBUG oslo_concurrency.lockutils [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Releasing lock "singleton_lock" {{(pid=76006) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 10:59:23 devstack cinder-volume[76006]: WARNING amqp [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 10:59:23 devstack cinder-volume[76006]: WARNING amqp [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 10:59:23 devstack cinder-volume[75856]: INFO oslo_service.backend._eventlet.service [None req-2231a78d-76bb-4252-ae69-a8f1bbccb814 None None] Child 76006 exited with status 0 Jul 16 10:59:23 devstack cinder-volume[86544]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 16 10:59:23 devstack cinder-volume[86544]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 10:59:23 devstack cinder-volume[86544]: we strongly recommend against using it for new projects. Jul 16 10:59:23 devstack cinder-volume[86544]: If you are already using Eventlet, we recommend migrating to a different Jul 16 10:59:23 devstack cinder-volume[86544]: framework. For more detail see Jul 16 10:59:23 devstack cinder-volume[86544]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 10:59:23 devstack cinder-volume[86544]: import eventlet # noqa Jul 16 10:59:25 devstack cinder-volume[86544]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86544) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 10:59:25 devstack cinder-volume[86544]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86544) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 10:59:25 devstack cinder-volume[86544]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86544) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 10:59:26 devstack cinder-volume[86544]: INFO dbcounter [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Registered counter for database cinder Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_db.sqlalchemy.engines [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86544) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG dbcounter [-] [86544] Writer thread running {{(pid=86544) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 10:59:26 devstack cinder-volume[86544]: INFO cinder.rpc [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 16 10:59:26 devstack cinder-volume[86544]: INFO cinder.rpc [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_db.sqlalchemy.engines [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86544) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:59:26 devstack cinder-volume[86544]: INFO cinder.volume.manager [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Determined volume DB was empty at startup. Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG cinder.volume.manager [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86544) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 16 10:59:26 devstack cinder-volume[86544]: INFO cinder.volume.manager [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 16 10:59:26 devstack cinder-volume[86544]: WARNING stevedore.named [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 10:59:26 devstack cinder-volume[86544]: WARNING castellan.key_manager [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 10:59:26 devstack cinder-volume[86544]: WARNING cinder.keymgr.conf_key_mgr [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 10:59:26 devstack cinder-volume[86544]: INFO cinder.volume.manager [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_db.sqlalchemy.engines [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86544) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:59:26 devstack cinder-volume[86544]: INFO oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Starting 1 workers Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Started child 86757 {{(pid=86544) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Full set of CONF: {{(pid=86544) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] ******************************************************************************** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Configuration options gathered from: {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] ================================================================================ {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] allow_availability_zone_fallback = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] allow_compression_on_image_upload = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] allowed_direct_url_schemes = [] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] api_rate_limit = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] auth_strategy = keystone {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_availability_zone = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_host = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_name = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_stats_polling_interval = 60 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86757]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backup_api_class = cinder.backup.api.API {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backup_name_template = backup-%s {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backup_use_same_host = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backup_use_temp_snapshot = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] chap_password = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] chap_username = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cinder_internal_tenant_project_id = 9b5d4208cf92418182656548d0ddbc27 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cinder_internal_tenant_user_id = 822304e675dd4ab4a083b7c74ab0398f {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cluster = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] compression_format = gzip {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] compute_api_class = cinder.compute.nova.API {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] config_dir = [] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] config_source = [] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:26 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] control_exchange = openstack {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] debug = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] default_availability_zone = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] default_group_type = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] default_volume_type = QuobyteHD {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] disk_geometry = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] driver_client_cert = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] driver_client_cert_key = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] driver_data_namespace = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] driver_ssl_cert_path = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] driver_ssl_cert_verify = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] driver_use_ssl = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] enable_new_services = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] enable_unsupported_driver = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] enabled_backends = ['QuobyteHD'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] enforce_multipath_for_image_xfer = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] filter_function = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance_api_insecure = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance_api_servers = ['http://192.168.122.104/image'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance_api_ssl_compression = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance_ca_certificates_file = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance_catalog_info = image:glance:publicURL {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance_certfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance_keyfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance_num_retries = 3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance_request_timeout = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] goodness_function = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] graceful_shutdown_timeout = 5 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] group_api_class = cinder.group.api.API {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] host = devstack {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] image_compress_on_upload = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] image_conversion_address_space_limit = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] image_conversion_cpu_limit = 60 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] image_conversion_disable = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] image_upload_use_cinder_backend = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] image_upload_use_internal_tenant = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] image_volume_cache_enabled = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] image_volume_cache_max_count = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] image_volume_cache_max_size_gb = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] init_host_max_objects_retrieval = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] instance_format = [instance: %(uuid)s] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] iscsi_target_flags = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] iscsi_write_cache = on {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] iser_helper = tgtadm {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] iser_ip_address = 192.168.122.104 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] iser_port = 3260 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] log_color = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] log_config_append = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] log_dir = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] log_file = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] log_options = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] log_rotate_interval = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] log_rotate_interval_type = days {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] log_rotation_type = none {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] max_age = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] max_logfile_count = 30 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] max_logfile_size_mb = 200 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] max_over_subscription_ratio = 20.0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] message_reap_interval = 86400 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] message_ttl = 2592000 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] migration_create_volume_timeout_secs = 300 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] monkey_patch = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] monkey_patch_modules = [] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] my_ip = 192.168.122.104 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] no_snapshot_gb_quota = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] num_iser_scan_tries = 3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] num_shell_tries = 3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] num_volume_device_scan_tries = 3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] nvmeof_conn_info_version = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] nvmet_ns_id = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] nvmet_port_id = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] osapi_max_limit = 1000 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] osapi_volume_ext_list = [] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] osapi_volume_listen = 0.0.0.0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] osapi_volume_listen_port = 8776 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] osapi_volume_use_ssl = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] osapi_volume_workers = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] per_volume_size_limit = -1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] periodic_fuzzy_delay = 60 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] periodic_interval = 60 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] project_id_regex = [0-9a-f\-]+ {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] public_endpoint = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] publish_errors = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] quota_backup_gigabytes = 1000 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] quota_backups = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] quota_gigabytes = 1000 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] quota_groups = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] quota_snapshots = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] quota_volumes = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] rate_limit_burst = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] rate_limit_except_level = CRITICAL {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] rate_limit_interval = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] reinit_driver_count = 3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] replication_device = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] report_discard_supported = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] report_interval = 120 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] reservation_clean_interval = 86400 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] reservation_expire = 86400 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] reserved_image_namespaces = [] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] reserved_percentage = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] rpc_response_timeout = 120 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] run_external_periodic_tasks = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] scst_target_driver = iscsi {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] scst_target_iqn_name = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] service_down_time = 720 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] shell_completion = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] snapshot_name_template = snapshot-%s {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] split_loggers = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] state_path = /opt/stack/data/cinder {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] storage_availability_zone = nova {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] storage_protocol = iSCSI {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] syslog_log_facility = LOG_USER {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] target_helper = lioadm {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] target_ip_address = 192.168.122.104 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] target_port = 3260 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] target_protocol = iscsi {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] target_secondary_ip_addresses = [] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] trace_flags = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] transfer_api_class = cinder.transfer.api.API {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] transport_url = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] until_refresh = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] use_chap_auth = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] use_default_quota_class = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] use_journal = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] use_json = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] use_multipath_for_image_xfer = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] use_stderr = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] use_syslog = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] verify_glance_signatures = enabled {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_api_class = cinder.volume.api.API {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_backend_name = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_clear = zero {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_clear_ionice = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_clear_size = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_copy_bps_limit = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_dd_blocksize = 1M {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_name_template = volume-%s {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_service_inithost_offload = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volume_usage_audit_period = month {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] zoning_mode = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_concurrency.disable_process_locking = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.auth_section = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.auth_type = password {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.auth_version = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.cache = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.certfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.delay_auth_decision = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.http_connect_timeout = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.include_service_catalog = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.insecure = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86757]: INFO cinder.volume.manager [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Starting volume driver QuobyteDriver (1.2) Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.interface = public {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG cinder.volume.drivers.remotefs [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86757) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.keyfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_password = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcache_username = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.region_name = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.service_token_roles_required = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.service_type = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.token_cache_time = 300 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.104/identity {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.backend = dogpile.cache.null {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.backend_argument = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.backend_expiration_time = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.config_prefix = cache.oslo {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.debug_cache_backend = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.enable_retry_client = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.enable_socket_keepalive = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.enabled = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.expiration_time = 600 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.hashclient_retry_attempts = 2 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.memcache_dead_retry = 300 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.memcache_pool_maxsize = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.memcache_sasl_enabled = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.password = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.proxies = [] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.redis_db = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.redis_sentinel_service_name = mymaster {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.redis_server = localhost:6379 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.retry_attempts = 2 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.retry_delay = 0.0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.socket_keepalive_count = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.socket_keepalive_idle = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.socket_keepalive_interval = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.socket_timeout = 1.0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.tls_allowed_ciphers = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.tls_cafile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.tls_certfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.tls_enabled = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.tls_keyfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cache.username = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] coordination.backend_url = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.asyncio_connection = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.asyncio_slave_connection = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.backend = sqlalchemy {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.connection = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.connection_debug = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.connection_parameters = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.connection_recycle_time = 3600 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.connection_trace = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.db_inc_retry_interval = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.db_max_retries = 20 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.db_max_retry_interval = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.db_retry_interval = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.max_overflow = 50 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.max_pool_size = 5 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.max_retries = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.mysql_wsrep_sync_wait = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.pool_timeout = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.retry_interval = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.slave_connection = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.sqlite_synchronous = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.synchronous_reader = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] database.use_db_reconnect = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler.connection_string = messaging:// {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler.enabled = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler.es_doc_type = notification {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler.es_scroll_size = 10000 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler.es_scroll_time = 2m {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler.filter_error_trace = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler.hmac_keys = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler.sentinel_service_name = mymaster {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler.socket_timeout = 0.1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler.trace_requests = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler.trace_sqlalchemy = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler_jaeger.process_tags = {} {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler_jaeger.service_name_prefix = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] profiler_otlp.service_name_prefix = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_policy.enforce_new_defaults = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_policy.enforce_scope = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_policy.policy_default_rule = default {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_policy.policy_file = policy.yaml {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_policy.remote_timeout = 60.0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] privsep_osbrick.group = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] privsep_osbrick.helper_command = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] privsep_osbrick.user = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cinder_sys_admin.group = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cinder_sys_admin.helper_command = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] cinder_sys_admin.user = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] service_user.auth_section = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] service_user.auth_type = password {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] service_user.cafile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] service_user.certfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] service_user.collect_timing = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] service_user.insecure = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] service_user.keyfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] service_user.send_service_user_token = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] service_user.split_loggers = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] service_user.timeout = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance.auth_section = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance.auth_type = password {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance.certfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance.collect_timing = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance.insecure = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance.keyfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance.region_name = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance.split_loggers = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] glance.timeout = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.backend_availability_zone = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.chap_password = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.chap_username = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.disk_geometry = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.driver_client_cert = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.driver_client_cert_key = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.driver_data_namespace = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.driver_use_ssl = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.enable_unsupported_driver = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.extra_capabilities = {} {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.filter_function = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.goodness_function = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.iscsi_target_flags = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.iscsi_write_cache = on {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.iser_helper = tgtadm {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.iser_ip_address = 192.168.122.104 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.iser_port = 3260 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nas_host = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nas_login = admin {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nas_mount_options = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nas_password = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nas_private_key = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nas_share_path = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nas_ssh_port = 22 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.num_shell_tries = 3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.nvmet_port_id = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.quobyte_client_cfg = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.quobyte_volume_url = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.replication_device = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.report_discard_supported = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.reserved_percentage = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.scst_target_driver = iscsi {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.scst_target_iqn_name = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.storage_protocol = iSCSI {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.target_helper = tgtadm {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.target_ip_address = 192.168.122.104 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.target_port = 3260 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.target_protocol = iscsi {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.trace_flags = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.unique_fqdn_network = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.use_chap_auth = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.volume_backend_name = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.volume_clear = zero {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.volume_clear_ionice = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.volume_clear_size = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_reports.file_event_handler = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_reports.log_dir = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.backend_availability_zone = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.backend_host = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.chap_password = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.chap_username = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.chiscsi_conf = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.disk_geometry = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.driver_client_cert = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.driver_client_cert_key = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.driver_data_namespace = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.driver_use_ssl = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.extra_capabilities = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.filter_function = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.goodness_function = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.iscsi_target_flags = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.iscsi_write_cache = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.iser_helper = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.iser_ip_address = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.iser_port = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.iser_target_prefix = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nas_host = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nas_login = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nas_mount_options = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nas_password = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nas_private_key = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nas_share_path = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nas_ssh_port = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.num_shell_tries = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nvmet_ns_id = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.nvmet_port_id = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.replication_device = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.report_discard_supported = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.reserved_percentage = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.scst_target_driver = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.storage_protocol = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.target_helper = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.target_ip_address = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.target_port = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.target_prefix = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.target_protocol = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.trace_flags = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.unique_fqdn_network = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.use_chap_auth = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.volume_clear = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.volume_clear_ionice = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.volume_clear_size = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] QuobyteHD.volumes_dir = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.ssl = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.ssl_version = {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_notifications.driver = [] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_notifications.retry = -1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] oslo_messaging_notifications.transport_url = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] key_manager.fixed_key = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.barbican_api_version = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.barbican_endpoint = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.barbican_endpoint_type = public {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.barbican_region_name = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.cafile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.certfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.collect_timing = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.insecure = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.keyfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.number_of_retries = 60 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.retry_delay = 1 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.send_service_user_token = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.split_loggers = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.timeout = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.verify_ssl = True {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican.verify_ssl_path = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican_service_user.auth_section = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican_service_user.auth_type = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican_service_user.cafile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican_service_user.certfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican_service_user.collect_timing = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican_service_user.insecure = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican_service_user.keyfile = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican_service_user.split_loggers = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] barbican_service_user.timeout = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.approle_role_id = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.approle_secret_id = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.auth_method = approle {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.auth_path = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.kv_mountpoint = secret {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.kv_path = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.kv_version = 2 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.namespace = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.root_token_id = **** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.ssl_ca_crt_file = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.timeout = 60.0 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.token_file = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.token_role = None {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.use_ssl = False {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:27 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] ******************************************************************************** {{(pid=86544) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG cinder.volume.drivers.quobyte [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86757) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 16 10:59:27 devstack cinder-volume[86757]: WARNING cinder.volume.drivers.quobyte [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 16 10:59:27 devstack cinder-volume[86757]: WARNING cinder.volume.drivers.quobyte [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG oslo_concurrency.processutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Running cmd (subprocess): mount.quobyte {{(pid=86757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:59:27 devstack quobyte-client[86758]: Reading configuration file: /etc/quobyte/client.cfg Jul 16 10:59:27 devstack quobyte-client[86758]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG oslo_concurrency.processutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] CMD "mount.quobyte" returned: 1 in 0.141s {{(pid=86757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86757) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86757) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG cinder.volume.drivers.quobyte [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=86757) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 10:59:27 devstack cinder-volume[86757]: INFO cinder.volume.drivers.quobyte [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 ... Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG oslo_concurrency.processutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 -c /etc/quobyte/client-cinder.cfg {{(pid=86757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:59:27 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 -c /etc/quobyte/client-cinder.cfg Jul 16 10:59:27 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:59:27 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG oslo_concurrency.processutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.357s {{(pid=86757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:59:27 devstack cinder-volume[86757]: INFO cinder.volume.drivers.quobyte [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 succeeded Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG cinder.volume.drivers.quobyte [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=86757) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.371s {{(pid=86757) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG oslo_concurrency.processutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=86757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:59:27 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 10:59:27 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:59:27 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG oslo_concurrency.processutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.241s {{(pid=86757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:59:27 devstack cinder-volume[86757]: INFO cinder.volume.driver [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Driver hasn't implemented _init_vendor_properties() Jul 16 10:59:27 devstack cinder-volume[86757]: DEBUG cinder.volume.driver [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86757) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG oslo_db.sqlalchemy.engines [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86757) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG dbcounter [-] [86757] Writer thread running {{(pid=86757) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG cinder.db.api [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Building query based on filter {{(pid=86757) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG cinder.image.image_utils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86757) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 16 10:59:28 devstack cinder-volume[86757]: INFO cinder.keymgr.migration [None req-15b64e38-4709-483e-a3d6-2f9e3244683d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86757) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86757) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG cinder.volume.drivers.quobyte [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=86757) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG cinder.volume.drivers.quobyte [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=86757) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86757) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG oslo_concurrency.processutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=86757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:59:28 devstack sudo[86835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 10:59:28 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:59:28 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG oslo_concurrency.processutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.235s {{(pid=86757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG cinder.manager [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Notifying Schedulers of capabilities ... {{(pid=86757) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 10:59:28 devstack cinder-volume[86757]: INFO cinder.volume.manager [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Driver initialization completed successfully. Jul 16 10:59:28 devstack cinder-volume[86757]: INFO cinder.manager [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Initiating service 3 cleanup Jul 16 10:59:28 devstack cinder-volume[86757]: INFO cinder.manager [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Service 3 cleanup completed. Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG cinder.service [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Creating RPC server for service cinder-volume {{(pid=86757) start /opt/stack/cinder/cinder/service.py:231}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG cinder.service [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86757) start /opt/stack/cinder/cinder/service.py:237}} Jul 16 10:59:28 devstack cinder-volume[86757]: INFO cinder.volume.manager [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86757) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86757) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG cinder.volume.drivers.quobyte [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=86757) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG cinder.volume.drivers.quobyte [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=86757) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86757) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG oslo_concurrency.processutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=86757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:59:28 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 10:59:28 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:59:28 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Jul 16 10:59:28 devstack cinder-volume[86757]: DEBUG oslo_concurrency.processutils [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.239s {{(pid=86757) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:59:28 devstack cinder-volume[86757]: INFO cinder.volume.manager [None req-4e45b15a-3dc5-4b26-a934-25c3615b4baf None None] Driver post RPC initialization completed successfully. Jul 16 10:59:32 devstack cinder-volume[86544]: INFO oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Caught SIGTERM, stopping children Jul 16 10:59:32 devstack cinder-volume[86544]: DEBUG oslo_concurrency.lockutils [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Acquiring lock "singleton_lock" {{(pid=86544) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 10:59:32 devstack cinder-volume[86544]: DEBUG oslo_concurrency.lockutils [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Acquired lock "singleton_lock" {{(pid=86544) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 10:59:32 devstack cinder-volume[86544]: DEBUG oslo_concurrency.lockutils [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Releasing lock "singleton_lock" {{(pid=86544) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 10:59:32 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Stop services. {{(pid=86544) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 16 10:59:32 devstack cinder-volume[86544]: DEBUG oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Killing children. {{(pid=86544) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 16 10:59:32 devstack cinder-volume[86544]: INFO oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Waiting on 1 children to exit Jul 16 10:59:32 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Acquiring lock "singleton_lock" {{(pid=86757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 10:59:32 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Acquired lock "singleton_lock" {{(pid=86757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 10:59:32 devstack cinder-volume[86757]: DEBUG oslo_concurrency.lockutils [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Releasing lock "singleton_lock" {{(pid=86757) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 10:59:32 devstack cinder-volume[86757]: WARNING amqp [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 10:59:32 devstack cinder-volume[86757]: WARNING amqp [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 10:59:32 devstack cinder-volume[86544]: INFO oslo_service.backend._eventlet.service [None req-2746850f-3ed7-4ace-8719-c3b5ece8acda None None] Child 86757 exited with status 0 Jul 16 10:59:33 devstack cinder-volume[87062]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 16 10:59:33 devstack cinder-volume[87062]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 10:59:33 devstack cinder-volume[87062]: we strongly recommend against using it for new projects. Jul 16 10:59:33 devstack cinder-volume[87062]: If you are already using Eventlet, we recommend migrating to a different Jul 16 10:59:33 devstack cinder-volume[87062]: framework. For more detail see Jul 16 10:59:33 devstack cinder-volume[87062]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 10:59:33 devstack cinder-volume[87062]: import eventlet # noqa Jul 16 10:59:36 devstack cinder-volume[87062]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 10:59:36 devstack cinder-volume[87062]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 10:59:36 devstack cinder-volume[87062]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87062) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 10:59:37 devstack cinder-volume[87062]: INFO dbcounter [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Registered counter for database cinder Jul 16 10:59:37 devstack cinder-volume[87062]: DEBUG oslo_db.sqlalchemy.engines [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:59:37 devstack cinder-volume[87062]: DEBUG dbcounter [-] [87062] Writer thread running {{(pid=87062) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 10:59:37 devstack cinder-volume[87062]: INFO cinder.rpc [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 16 10:59:37 devstack cinder-volume[87062]: INFO cinder.rpc [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 16 10:59:37 devstack cinder-volume[87062]: DEBUG oslo_db.sqlalchemy.engines [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:59:37 devstack cinder-volume[87062]: INFO cinder.volume.manager [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Determined volume DB was empty at startup. Jul 16 10:59:37 devstack cinder-volume[87062]: DEBUG cinder.volume.manager [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87062) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 16 10:59:37 devstack cinder-volume[87062]: WARNING stevedore.named [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 10:59:37 devstack cinder-volume[87062]: WARNING castellan.key_manager [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 10:59:37 devstack cinder-volume[87062]: WARNING cinder.keymgr.conf_key_mgr [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 10:59:37 devstack cinder-volume[87062]: INFO cinder.volume.manager [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_db.sqlalchemy.engines [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87062) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:59:38 devstack cinder-volume[87062]: INFO oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Starting 1 workers Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Started child 87345 {{(pid=87062) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Full set of CONF: {{(pid=87062) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] ******************************************************************************** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] Configuration options gathered from: {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] ================================================================================ {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] allow_availability_zone_fallback = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] allow_compression_on_image_upload = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] allowed_direct_url_schemes = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] api_rate_limit = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] auth_strategy = keystone {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_availability_zone = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87345]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_host = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_stats_polling_interval = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backup_api_class = cinder.backup.api.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backup_name_template = backup-%s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backup_use_same_host = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backup_use_temp_snapshot = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] chap_password = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] chap_username = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cinder_internal_tenant_project_id = 9b5d4208cf92418182656548d0ddbc27 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cinder_internal_tenant_user_id = 822304e675dd4ab4a083b7c74ab0398f {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cluster = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] compression_format = gzip {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] compute_api_class = cinder.compute.nova.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] config_dir = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] config_source = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] control_exchange = openstack {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] debug = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] default_availability_zone = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] default_group_type = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] default_volume_type = QuobyteHD {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] disk_geometry = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] driver_client_cert = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] driver_client_cert_key = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] driver_data_namespace = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] driver_ssl_cert_path = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] driver_ssl_cert_verify = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] driver_use_ssl = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] enable_new_services = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] enable_unsupported_driver = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] enabled_backends = ['QuobyteHD'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] enforce_multipath_for_image_xfer = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] filter_function = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance_api_insecure = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance_api_servers = ['http://192.168.122.104/image'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance_api_ssl_compression = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance_ca_certificates_file = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance_catalog_info = image:glance:publicURL {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance_certfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance_keyfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance_num_retries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance_request_timeout = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] goodness_function = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] graceful_shutdown_timeout = 5 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] group_api_class = cinder.group.api.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] host = devstack {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] image_compress_on_upload = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] image_conversion_address_space_limit = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] image_conversion_cpu_limit = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] image_conversion_disable = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] image_upload_use_cinder_backend = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] image_upload_use_internal_tenant = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] image_volume_cache_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] image_volume_cache_max_count = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] image_volume_cache_max_size_gb = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] init_host_max_objects_retrieval = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] instance_format = [instance: %(uuid)s] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] iscsi_target_flags = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] iscsi_write_cache = on {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] iser_helper = tgtadm {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] iser_ip_address = 192.168.122.104 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] iser_port = 3260 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Starting volume driver QuobyteDriver (1.2) Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87345) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] log_color = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] log_config_append = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] log_dir = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] log_file = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] log_options = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] log_rotate_interval = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] log_rotate_interval_type = days {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] log_rotation_type = none {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] max_age = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] max_logfile_count = 30 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] max_logfile_size_mb = 200 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] max_over_subscription_ratio = 20.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] message_reap_interval = 86400 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] message_ttl = 2592000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] migration_create_volume_timeout_secs = 300 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] monkey_patch = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] monkey_patch_modules = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] my_ip = 192.168.122.104 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] no_snapshot_gb_quota = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] num_iser_scan_tries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] num_shell_tries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] num_volume_device_scan_tries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] nvmeof_conn_info_version = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] nvmet_ns_id = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] nvmet_port_id = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] osapi_max_limit = 1000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] osapi_volume_ext_list = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] osapi_volume_listen_port = 8776 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] osapi_volume_use_ssl = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] osapi_volume_workers = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] per_volume_size_limit = -1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] periodic_fuzzy_delay = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] periodic_interval = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] public_endpoint = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] publish_errors = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] quota_backup_gigabytes = 1000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] quota_backups = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] quota_gigabytes = 1000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] quota_groups = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] quota_snapshots = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] quota_volumes = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] rate_limit_burst = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] rate_limit_except_level = CRITICAL {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] rate_limit_interval = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] reinit_driver_count = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] replication_device = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] report_discard_supported = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] report_interval = 120 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] reservation_clean_interval = 86400 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] reservation_expire = 86400 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] reserved_image_namespaces = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] reserved_percentage = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] rpc_response_timeout = 120 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] run_external_periodic_tasks = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] scst_target_driver = iscsi {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] scst_target_iqn_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] service_down_time = 720 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] shell_completion = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] snapshot_name_template = snapshot-%s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] split_loggers = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] state_path = /opt/stack/data/cinder {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] storage_availability_zone = nova {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] storage_protocol = iSCSI {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] syslog_log_facility = LOG_USER {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] target_helper = lioadm {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] target_ip_address = 192.168.122.104 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] target_port = 3260 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] target_protocol = iscsi {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] target_secondary_ip_addresses = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] trace_flags = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] transport_url = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] until_refresh = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] use_chap_auth = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] use_default_quota_class = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] use_journal = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] use_json = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] use_multipath_for_image_xfer = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] use_stderr = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] use_syslog = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] verify_glance_signatures = enabled {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_api_class = cinder.volume.api.API {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_backend_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_clear = zero {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_clear_ionice = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_clear_size = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_copy_bps_limit = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_dd_blocksize = 1M {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_name_template = volume-%s {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_service_inithost_offload = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volume_usage_audit_period = month {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] zoning_mode = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_concurrency.disable_process_locking = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.auth_section = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.auth_type = password {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.auth_version = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.cache = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.certfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.include_service_catalog = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.insecure = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.interface = public {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.keyfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_password = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcache_username = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.region_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.service_type = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.104/identity {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.backend = dogpile.cache.null {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.backend_argument = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.backend_expiration_time = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87345) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 16 10:59:38 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.quobyte [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 16 10:59:38 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.quobyte [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.config_prefix = cache.oslo {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.debug_cache_backend = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.enable_retry_client = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.enable_socket_keepalive = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.expiration_time = 600 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Running cmd (subprocess): mount.quobyte {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.hashclient_retry_attempts = 2 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.memcache_dead_retry = 300 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.memcache_pool_maxsize = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.memcache_sasl_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.password = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.proxies = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.redis_db = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.redis_server = localhost:6379 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.retry_attempts = 2 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.retry_delay = 0.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.socket_keepalive_count = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.socket_keepalive_idle = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.socket_keepalive_interval = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.socket_timeout = 1.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.tls_allowed_ciphers = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.tls_cafile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.tls_certfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.tls_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.tls_keyfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cache.username = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] coordination.backend_url = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.asyncio_connection = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.asyncio_slave_connection = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.backend = sqlalchemy {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.connection = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.connection_debug = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.connection_parameters = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.connection_recycle_time = 3600 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.connection_trace = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.db_inc_retry_interval = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.db_max_retries = 20 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.db_max_retry_interval = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.db_retry_interval = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.max_overflow = 50 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.max_pool_size = 5 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.max_retries = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.mysql_wsrep_sync_wait = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.pool_timeout = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.retry_interval = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.slave_connection = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.sqlite_synchronous = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.synchronous_reader = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] database.use_db_reconnect = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler.connection_string = messaging:// {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler.enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler.es_doc_type = notification {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler.es_scroll_size = 10000 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler.es_scroll_time = 2m {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler.filter_error_trace = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler.hmac_keys = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler.sentinel_service_name = mymaster {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler.socket_timeout = 0.1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler.trace_requests = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler.trace_sqlalchemy = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler_jaeger.process_tags = {} {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler_jaeger.service_name_prefix = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] profiler_otlp.service_name_prefix = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_policy.enforce_new_defaults = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_policy.enforce_scope = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_policy.policy_default_rule = default {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_policy.policy_file = policy.yaml {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack quobyte-client[87374]: Reading configuration file: /etc/quobyte/client.cfg Jul 16 10:59:38 devstack quobyte-client[87374]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] privsep_osbrick.group = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] privsep_osbrick.helper_command = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] privsep_osbrick.user = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cinder_sys_admin.group = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cinder_sys_admin.helper_command = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] cinder_sys_admin.user = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] service_user.auth_section = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] service_user.auth_type = password {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] service_user.cafile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] service_user.certfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] service_user.collect_timing = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] service_user.insecure = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] service_user.keyfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] service_user.send_service_user_token = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] service_user.split_loggers = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] service_user.timeout = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance.auth_section = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance.auth_type = password {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance.certfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance.collect_timing = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance.insecure = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance.keyfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance.region_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance.split_loggers = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] glance.timeout = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.backend_availability_zone = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.chap_password = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.chap_username = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.disk_geometry = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.driver_client_cert = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.driver_client_cert_key = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.driver_data_namespace = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.driver_use_ssl = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.extra_capabilities = {} {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.filter_function = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.goodness_function = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.iscsi_target_flags = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.iscsi_write_cache = on {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.iser_helper = tgtadm {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.iser_ip_address = 192.168.122.104 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.iser_port = 3260 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nas_host = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nas_login = admin {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nas_mount_options = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nas_password = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nas_private_key = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nas_share_path = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.num_shell_tries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.quobyte_volume_url = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.replication_device = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.report_discard_supported = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.reserved_percentage = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.target_helper = tgtadm {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.target_ip_address = 192.168.122.104 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.target_port = 3260 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.target_protocol = iscsi {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.trace_flags = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.unique_fqdn_network = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.use_chap_auth = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.volume_backend_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.volume_clear = zero {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.volume_clear_ionice = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.volume_clear_size = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_reports.file_event_handler = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_reports.log_dir = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.backend_availability_zone = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.backend_host = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.chap_password = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.chap_username = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.chiscsi_conf = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.disk_geometry = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.driver_client_cert = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.driver_data_namespace = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.driver_use_ssl = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.extra_capabilities = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.filter_function = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.goodness_function = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.iser_helper = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.iser_ip_address = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.iser_port = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.iser_target_prefix = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nas_host = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nas_login = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nas_mount_options = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nas_password = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nas_private_key = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nas_share_path = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nas_ssh_port = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.num_shell_tries = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.nvmet_port_id = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.replication_device = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.report_discard_supported = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.reserved_percentage = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.scst_target_driver = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.storage_protocol = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.target_helper = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.target_ip_address = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.target_port = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.target_prefix = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.target_protocol = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.trace_flags = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.use_chap_auth = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.volume_clear = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.volume_clear_size = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] QuobyteHD.volumes_dir = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.ssl = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_notifications.driver = [] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_notifications.retry = -1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] key_manager.fixed_key = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.barbican_api_version = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.barbican_endpoint = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.barbican_endpoint_type = public {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.barbican_region_name = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.cafile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.certfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.collect_timing = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.insecure = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.keyfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.number_of_retries = 60 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.retry_delay = 1 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.send_service_user_token = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.split_loggers = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.timeout = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.verify_ssl = True {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican.verify_ssl_path = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican_service_user.auth_section = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican_service_user.auth_type = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican_service_user.cafile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican_service_user.certfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican_service_user.collect_timing = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican_service_user.insecure = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican_service_user.keyfile = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican_service_user.split_loggers = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] barbican_service_user.timeout = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.approle_role_id = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.approle_secret_id = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.auth_method = approle {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.auth_path = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.kv_mountpoint = secret {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.kv_path = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.kv_version = 2 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.namespace = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.root_token_id = **** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.ssl_ca_crt_file = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.timeout = 60.0 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.token_file = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.token_role = None {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.use_ssl = False {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 10:59:38 devstack cinder-volume[87062]: DEBUG oslo_service.backend._eventlet.service [None req-a84f178f-1cc7-4db6-b80b-a63ce56e5460 None None] ******************************************************************************** {{(pid=87062) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 16 10:59:38 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.266s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:59:38 devstack cinder-volume[87345]: INFO cinder.volume.driver [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Driver hasn't implemented _init_vendor_properties() Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG cinder.volume.driver [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87345) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_db.sqlalchemy.engines [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writer thread running {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG cinder.db.api [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Building query based on filter {{(pid=87345) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87345) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 10:59:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:59:38 devstack cinder-volume[87345]: INFO cinder.keymgr.migration [None req-7688ce96-c1bb-4776-b6f2-0846f3fae465 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 16 10:59:38 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 10:59:38 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:59:39 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Jul 16 10:59:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.257s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:59:39 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 10:59:39 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Driver initialization completed successfully. Jul 16 10:59:39 devstack cinder-volume[87345]: INFO cinder.manager [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Initiating service 3 cleanup Jul 16 10:59:39 devstack cinder-volume[87345]: INFO cinder.manager [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Service 3 cleanup completed. Jul 16 10:59:39 devstack cinder-volume[87345]: DEBUG cinder.service [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Creating RPC server for service cinder-volume {{(pid=87345) start /opt/stack/cinder/cinder/service.py:231}} Jul 16 10:59:39 devstack cinder-volume[87345]: DEBUG cinder.service [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87345) start /opt/stack/cinder/cinder/service.py:237}} Jul 16 10:59:39 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 16 10:59:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 10:59:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 10:59:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 10:59:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 10:59:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 10:59:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 10:59:39 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 10:59:39 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 10:59:39 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Jul 16 10:59:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.272s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 10:59:39 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7d8a19f3-ef6f-4e7c-97ce-980867221d38 None None] Driver post RPC initialization completed successfully. Jul 16 10:59:48 devstack cinder-volume[87062]: DEBUG dbcounter [-] [87062] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87062) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 10:59:49 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 10:59:49 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=2 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:00:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:00:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 6 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:00:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Flow 'volume_create_manager' (fe58dfa5-0314-4a52-b0cc-af6702db1ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccff3995-52b8-4aa0-b6b2-80e1f0d5a1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccff3995-52b8-4aa0-b6b2-80e1f0d5a1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-843714801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd49b00f-5d09-4750-a966-35312ae90103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c689184d81754a22adb545a18951c304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:00:40Z,use_quota=True,user_id='61d766ca2ec24e69b867844f20505ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f147a83d-a0a4-4a8c-a0ed-5549bd9d644c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f147a83d-a0a4-4a8c-a0ed-5549bd9d644c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3509922e-0e8a-4a88-942b-688e8daae6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3509922e-0e8a-4a88-942b-688e8daae6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd49b00f-5d09-4750-a966-35312ae90103', 'volume_name': 'volume-cd49b00f-5d09-4750-a966-35312ae90103', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df70e1b3-de8a-4c2f-8f58-b8254b4b78c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df70e1b3-de8a-4c2f-8f58-b8254b4b78c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15137f5-de7c-48a5-8481-c9d38c88290d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:40 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Volume cd49b00f-5d09-4750-a966-35312ae90103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd49b00f-5d09-4750-a966-35312ae90103', 'volume_size': 1} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-843714801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd49b00f-5d09-4750-a966-35312ae90103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c689184d81754a22adb545a18951c304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:00:40Z,use_quota=True,user_id='61d766ca2ec24e69b867844f20505ae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Creating volume cd49b00f-5d09-4750-a966-35312ae90103 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:00:40 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:00:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:00:40 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103 1073741824 Jul 16 11:00:40 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:00:41 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Jul 16 11:00:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103 1073741824" returned: 0 in 0.573s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:00:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:00:41 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103 Jul 16 11:00:41 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:00:41 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Jul 16 11:00:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103" returned: 0 in 0.270s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:00:41 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:00:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:00:41 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e15137f5-de7c-48a5-8481-c9d38c88290d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd49b00f-5d09-4750-a966-35312ae90103', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:41 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1a575b-b5e8-44a0-94ce-89c6df171c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:41 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Volume volume-cd49b00f-5d09-4750-a966-35312ae90103 (cd49b00f-5d09-4750-a966-35312ae90103): created successfully Jul 16 11:00:41 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1a575b-b5e8-44a0-94ce-89c6df171c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:41 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Flow 'volume_create_manager' (fe58dfa5-0314-4a52-b0cc-af6702db1ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:00:41 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-81f3f9aa-247a-47a7-9a90-faacf830987b tempest-TaggedAttachmentsTest-1189789483 None] Created volume successfully. Jul 16 11:00:51 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:00:51 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Flow 'volume_create_manager' (aa1eac32-be46-4d5d-b12d-779eaf77c1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0787716d-9bed-46df-a53a-653930cb2a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0787716d-9bed-46df-a53a-653930cb2a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2117374853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75624b65-96c6-482c-88a6-802121060fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b7f0957fd94cf9b48b030220fb537c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:00:52Z,use_quota=True,user_id='685d7b8179f3424a817bc5f28357bd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfacca1-0b01-4b8f-8a5b-e861b22b6ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bfacca1-0b01-4b8f-8a5b-e861b22b6ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67242c3-9a17-469c-8d1b-b8010c539bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67242c3-9a17-469c-8d1b-b8010c539bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75624b65-96c6-482c-88a6-802121060fd0', 'volume_name': 'volume-75624b65-96c6-482c-88a6-802121060fd0', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5d3974-818b-42bc-b248-c3400c099f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5d3974-818b-42bc-b248-c3400c099f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e31e812-615e-4b1f-a88d-d8193bd8a5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:52 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Volume 75624b65-96c6-482c-88a6-802121060fd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75624b65-96c6-482c-88a6-802121060fd0', 'volume_size': 1} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2117374853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75624b65-96c6-482c-88a6-802121060fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b7f0957fd94cf9b48b030220fb537c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:00:52Z,use_quota=True,user_id='685d7b8179f3424a817bc5f28357bd9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Creating volume 75624b65-96c6-482c-88a6-802121060fd0 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:00:52 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:00:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:00:52 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0 1073741824 Jul 16 11:00:52 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:00:53 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Jul 16 11:00:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0 1073741824" returned: 0 in 0.758s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:00:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:00:53 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0 Jul 16 11:00:53 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:00:53 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Jul 16 11:00:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0" returned: 0 in 0.428s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:00:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:00:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:00:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e31e812-615e-4b1f-a88d-d8193bd8a5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75624b65-96c6-482c-88a6-802121060fd0', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4007a29b-2424-4175-ace0-b6539bb1854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:00:53 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Volume volume-75624b65-96c6-482c-88a6-802121060fd0 (75624b65-96c6-482c-88a6-802121060fd0): created successfully Jul 16 11:00:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4007a29b-2424-4175-ace0-b6539bb1854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:00:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Flow 'volume_create_manager' (aa1eac32-be46-4d5d-b12d-779eaf77c1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:00:53 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-91807a51-71dc-4424-a598-70b181911518 tempest-DeleteServersTestJSON-786761488 None] Created volume successfully. Jul 16 11:00:59 devstack cinder-volume[87345]: WARNING py.warnings [req-e1ea9dd3-7f7e-4939-bcce-5b47ef9b5f49 req-aa914f8c-3aea-433c-a6c4-1f382b89a30f tempest-DeleteServersTestJSON-786761488 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 16 11:00:59 devstack cinder-volume[87345]: .first() Jul 16 11:00:59 devstack cinder-volume[87345]: Jul 16 11:00:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-e1ea9dd3-7f7e-4939-bcce-5b47ef9b5f49 req-aa914f8c-3aea-433c-a6c4-1f382b89a30f tempest-DeleteServersTestJSON-786761488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:00:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-e1ea9dd3-7f7e-4939-bcce-5b47ef9b5f49 req-aa914f8c-3aea-433c-a6c4-1f382b89a30f tempest-DeleteServersTestJSON-786761488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:00:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-e1ea9dd3-7f7e-4939-bcce-5b47ef9b5f49 req-aa914f8c-3aea-433c-a6c4-1f382b89a30f tempest-DeleteServersTestJSON-786761488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:00:59 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-e1ea9dd3-7f7e-4939-bcce-5b47ef9b5f49 req-aa914f8c-3aea-433c-a6c4-1f382b89a30f tempest-DeleteServersTestJSON-786761488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-75624b65-96c6-482c-88a6-802121060fd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6d7d8af-5d3b-4347-88dc-f88e1e0a19ee', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:00:59 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-e1ea9dd3-7f7e-4939-bcce-5b47ef9b5f49 req-aa914f8c-3aea-433c-a6c4-1f382b89a30f tempest-DeleteServersTestJSON-786761488 None] attachment_update completed successfully. Jul 16 11:01:06 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-06d46e28-bbd0-4c3a-99e8-9742c8ebc2fb req-ddcff4b2-c74f-4afa-8828-a3a6fe662942 tempest-DeleteServersTestJSON-786761488 None] Terminate volume connection completed successfully. Jul 16 11:01:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-06d46e28-bbd0-4c3a-99e8-9742c8ebc2fb req-ddcff4b2-c74f-4afa-8828-a3a6fe662942 tempest-DeleteServersTestJSON-786761488 None] Deleting attachment a6d7d8af-5d3b-4347-88dc-f88e1e0a19ee. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Flow 'volume_create_manager' (ed0cdbce-b584-4b27-b0af-ca9f79a38f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be398c9-6b74-4a9a-b018-3b005760e2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be398c9-6b74-4a9a-b018-3b005760e2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1695211908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ad865a-3489-41b3-88c7-605daffdd78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201d0d9a19864f5eb80747d534a5d66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:01:08Z,use_quota=True,user_id='ea9e8573a00f42538bf1df77de2a826a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad2b6fe-d4cb-4fe5-846f-be58d7b39634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad2b6fe-d4cb-4fe5-846f-be58d7b39634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b65ebb1-0c61-4c4a-8e7f-2ca9a48476ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b65ebb1-0c61-4c4a-8e7f-2ca9a48476ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ad865a-3489-41b3-88c7-605daffdd78d', 'volume_name': 'volume-e0ad865a-3489-41b3-88c7-605daffdd78d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a690d7-35df-42e7-82c5-36703e44157e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a690d7-35df-42e7-82c5-36703e44157e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbda3ea-b6b6-42fa-8377-5f269522813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:01:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Volume e0ad865a-3489-41b3-88c7-605daffdd78d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ad865a-3489-41b3-88c7-605daffdd78d', 'volume_size': 1} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1695211908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ad865a-3489-41b3-88c7-605daffdd78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='201d0d9a19864f5eb80747d534a5d66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:01:08Z,use_quota=True,user_id='ea9e8573a00f42538bf1df77de2a826a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Creating volume e0ad865a-3489-41b3-88c7-605daffdd78d {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:01:08 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:01:08 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d 1073741824 Jul 16 11:01:08 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Acquiring lock "cinder-75624b65-96c6-482c-88a6-802121060fd0-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Lock "cinder-75624b65-96c6-482c-88a6-802121060fd0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Acquiring lock "cinder-quobyte-75624b65-96c6-482c-88a6-802121060fd0" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:01:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Lock "cinder-quobyte-75624b65-96c6-482c-88a6-802121060fd0" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:01:08 devstack cinder-volume[87345]: INFO oslo.privsep.daemon [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplz8qgixf/privsep.sock'] Jul 16 11:01:08 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplz8qgixf/privsep.sock Jul 16 11:01:08 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:01:09 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Jul 16 11:01:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d 1073741824" returned: 0 in 0.952s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:01:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:01:09 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d Jul 16 11:01:09 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:01:09 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Jul 16 11:01:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d" returned: 0 in 0.583s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:01:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:01:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:01:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbda3ea-b6b6-42fa-8377-5f269522813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ad865a-3489-41b3-88c7-605daffdd78d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:01:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c50700-d9db-4c89-a52a-b67bf6f40dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:01:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Volume volume-e0ad865a-3489-41b3-88c7-605daffdd78d (e0ad865a-3489-41b3-88c7-605daffdd78d): created successfully Jul 16 11:01:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c50700-d9db-4c89-a52a-b67bf6f40dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:01:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Flow 'volume_create_manager' (ed0cdbce-b584-4b27-b0af-ca9f79a38f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:01:10 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-1795cb61-044b-4f45-ac10-5a205b3a0295 tempest-VolumesAdminNegativeTest-1357003119 None] Created volume successfully. Jul 16 11:01:10 devstack cinder-volume[87345]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 16 11:01:10 devstack cinder-volume[87345]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 11:01:10 devstack cinder-volume[87345]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 16 11:01:10 devstack cinder-volume[87345]: WARNING oslo.privsep.daemon [-] privsep log: Jul 16 11:01:10 devstack cinder-volume[87345]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 16 11:01:10 devstack cinder-volume[87345]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 16 11:01:10 devstack cinder-volume[87345]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 11:01:10 devstack cinder-volume[87345]: WARNING oslo.privsep.daemon [-] privsep log: Jul 16 11:01:10 devstack cinder-volume[87345]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 16 11:01:11 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Jul 16 11:01:11 devstack cinder-volume[87345]: INFO oslo.privsep.daemon [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Spawned new privsep daemon via rootwrap Jul 16 11:01:11 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Accepted privsep connection to /tmp/tmplz8qgixf/privsep.sock {{(pid=87345) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 16 11:01:11 devstack cinder-volume[87345]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 16 11:01:11 devstack cinder-volume[87345]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 16 11:01:11 devstack cinder-volume[87345]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 16 11:01:11 devstack cinder-volume[87345]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88904 Jul 16 11:01:11 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffb8f52-1160-4338-83ef-080f470f7a56]: (2,) {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:01:11 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6d769f-a034-4223-8773-3e9decb6e945]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:01:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:01:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Acquiring lock "cinder-e0ad865a-3489-41b3-88c7-605daffdd78d-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:01:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Lock "cinder-e0ad865a-3489-41b3-88c7-605daffdd78d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:01:11 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0 Jul 16 11:01:11 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:01:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Acquiring lock "cinder-quobyte-e0ad865a-3489-41b3-88c7-605daffdd78d" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:01:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Lock "cinder-quobyte-e0ad865a-3489-41b3-88c7-605daffdd78d" acquired by "delete_volume" :: waited 0.044s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:01:11 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c78eb04-1d6d-4adf-8c1e-607792b008e9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:01:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:01:11 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d Jul 16 11:01:11 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:01:12 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Jul 16 11:01:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0" returned: 0 in 1.073s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:01:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:01:12 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0 Jul 16 11:01:12 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:01:12 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Jul 16 11:01:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d" returned: 0 in 0.970s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:01:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:01:12 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d Jul 16 11:01:12 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:01:13 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-75624b65-96c6-482c-88a6-802121060fd0" returned: 0 in 0.868s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:01:13 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Lock "cinder-quobyte-75624b65-96c6-482c-88a6-802121060fd0" released by "delete_volume" :: held 4.328s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e0ad865a-3489-41b3-88c7-605daffdd78d" returned: 0 in 0.553s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Lock "cinder-quobyte-e0ad865a-3489-41b3-88c7-605daffdd78d" released by "delete_volume" :: held 1.626s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:01:13 devstack cinder-volume[87345]: WARNING cinder.quota [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:01:13 devstack cinder-volume[87345]: WARNING cinder.quota [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Created reservations ['ca97c713-2247-4177-bfb0-b3aed47d66a9', 'effe8fd8-b5d0-4b48-ab55-5f4c86fdc0d0', 'f6d2533a-e32e-48fb-a7b8-bb6a91fdf989', '629f4637-4d83-4809-aa5c-e8f2661f93d6'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Created reservations ['5f526978-94d6-418a-b5b9-0f8974ff6d4f', '9403fea7-2c2b-470d-a7c1-815d5d2bbf31', 'f045cdd5-4533-47d3-bdbe-7a547ccfa14c', '5a42f92c-a6ab-4bbc-b1f0-2786e7b40dbc'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:01:13 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:01:13 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:01:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:01:13 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:01:13 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:01:14 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Jul 16 11:01:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.629s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:01:14 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:01:14 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Deleted volume successfully. Jul 16 11:01:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-10d3a4d9-4ba3-4194-ae82-8a000ec5fb3c tempest-DeleteServersTestJSON-786761488 None] Lock "cinder-75624b65-96c6-482c-88a6-802121060fd0-delete_volume" released by "delete_volume" :: held 5.801s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:01:14 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Jul 16 11:01:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.738s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:01:14 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:01:14 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Deleted volume successfully. Jul 16 11:01:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-13094a56-4be9-4547-a11a-8f9f2e6e96a0 tempest-VolumesAdminNegativeTest-1357003119 None] Lock "cinder-e0ad865a-3489-41b3-88c7-605daffdd78d-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:01:24 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=18,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=3 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:01:24 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:01:34 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:01:34 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:01:34 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.295s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 8 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:01:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:01:49 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:01:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-ba81fa70-ff23-45a0-b553-9cb8b11d6384 req-f9614f84-32bc-4e75-b9bf-770f513746c2 tempest-TaggedAttachmentsTest-1189789483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:01:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-ba81fa70-ff23-45a0-b553-9cb8b11d6384 req-f9614f84-32bc-4e75-b9bf-770f513746c2 tempest-TaggedAttachmentsTest-1189789483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:01:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-ba81fa70-ff23-45a0-b553-9cb8b11d6384 req-f9614f84-32bc-4e75-b9bf-770f513746c2 tempest-TaggedAttachmentsTest-1189789483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.057s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:01:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-ba81fa70-ff23-45a0-b553-9cb8b11d6384 req-f9614f84-32bc-4e75-b9bf-770f513746c2 tempest-TaggedAttachmentsTest-1189789483 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-cd49b00f-5d09-4750-a966-35312ae90103', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45ca0e8c-69ef-436b-874b-415027304d9b', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:01:52 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-ba81fa70-ff23-45a0-b553-9cb8b11d6384 req-f9614f84-32bc-4e75-b9bf-770f513746c2 tempest-TaggedAttachmentsTest-1189789483 None] attachment_update completed successfully. Jul 16 11:01:58 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-b583b305-acee-4a97-8fc0-c50b5a6cc976 req-06d8238c-e005-4ee4-b8d1-01bbd4e1e743 tempest-TaggedAttachmentsTest-1189789483 None] Terminate volume connection completed successfully. Jul 16 11:01:58 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-b583b305-acee-4a97-8fc0-c50b5a6cc976 req-06d8238c-e005-4ee4-b8d1-01bbd4e1e743 tempest-TaggedAttachmentsTest-1189789483 None] Deleting attachment 45ca0e8c-69ef-436b-874b-415027304d9b. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:02:02 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Flow 'volume_create_manager' (d977fc18-787e-4656-99b9-483e4904afb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a3afa4-8038-42c1-86fc-73b98d20e726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a3afa4-8038-42c1-86fc-73b98d20e726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1144354204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f09914a-4be9-4d63-8b48-276c53615a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8986b3247c7d459bb90cba572c1abc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:02:07Z,use_quota=True,user_id='89830d3301604162b6cec4a1d4025e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f078c5ea-2194-42a3-8f45-506a86533642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f078c5ea-2194-42a3-8f45-506a86533642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff334084-fb04-40fe-97ce-b90b7f59f674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff334084-fb04-40fe-97ce-b90b7f59f674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f09914a-4be9-4d63-8b48-276c53615a99', 'volume_name': 'volume-3f09914a-4be9-4d63-8b48-276c53615a99', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c71495-1e2a-43c8-a1b3-4eed08d3a636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c71495-1e2a-43c8-a1b3-4eed08d3a636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62eef7d-2da0-46af-a0db-3c6fac3c1f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Volume 3f09914a-4be9-4d63-8b48-276c53615a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f09914a-4be9-4d63-8b48-276c53615a99', 'volume_size': 1} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1144354204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f09914a-4be9-4d63-8b48-276c53615a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8986b3247c7d459bb90cba572c1abc0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:02:07Z,use_quota=True,user_id='89830d3301604162b6cec4a1d4025e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Creating volume 3f09914a-4be9-4d63-8b48-276c53615a99 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:02:07 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:02:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:07 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99 1073741824 Jul 16 11:02:07 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:08 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99 1073741824" returned: 0 in 1.363s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:09 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99 Jul 16 11:02:09 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:09 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99" returned: 0 in 0.527s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:02:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62eef7d-2da0-46af-a0db-3c6fac3c1f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f09914a-4be9-4d63-8b48-276c53615a99', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cae23b-cb3d-48e7-9b02-171156b0a6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Volume volume-3f09914a-4be9-4d63-8b48-276c53615a99 (3f09914a-4be9-4d63-8b48-276c53615a99): created successfully Jul 16 11:02:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cae23b-cb3d-48e7-9b02-171156b0a6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Flow 'volume_create_manager' (d977fc18-787e-4656-99b9-483e4904afb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:02:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-96875999-6aa8-4f4d-b261-240082fdeb2d tempest-ServerRescueNegativeTestJSON-26001045 None] Created volume successfully. Jul 16 11:02:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Acquiring lock "cinder-cd49b00f-5d09-4750-a966-35312ae90103-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:02:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Lock "cinder-cd49b00f-5d09-4750-a966-35312ae90103-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:02:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Acquiring lock "cinder-quobyte-cd49b00f-5d09-4750-a966-35312ae90103" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:02:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Lock "cinder-quobyte-cd49b00f-5d09-4750-a966-35312ae90103" acquired by "delete_volume" :: waited 0.034s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:02:18 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9286fba-4501-4ac9-807c-45e65fa8ead0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:02:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:18 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103 Jul 16 11:02:18 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:18 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103" returned: 0 in 0.612s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:18 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103 Jul 16 11:02:18 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:19 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd49b00f-5d09-4750-a966-35312ae90103" returned: 0 in 0.484s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Lock "cinder-quobyte-cd49b00f-5d09-4750-a966-35312ae90103" released by "delete_volume" :: held 1.184s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:02:19 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Created reservations ['355776f5-7c44-4d44-a57f-7e923f4f8ef6', '462a2e29-0aca-4c5b-9ad0-53030d85ce43', '03a18275-8e74-40aa-99ad-705b5b5c0d04', '3d6feb12-b4c9-4664-a8e3-03d2c9f769d8'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:02:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:02:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:02:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:19 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:02:19 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:20 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.830s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:20 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:02:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Deleted volume successfully. Jul 16 11:02:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-25a71955-7bb8-4d98-893b-9c7569c5d987 tempest-TaggedAttachmentsTest-1189789483 None] Lock "cinder-cd49b00f-5d09-4750-a966-35312ae90103-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:02:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Acquiring lock "cinder-3f09914a-4be9-4d63-8b48-276c53615a99-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:02:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Lock "cinder-3f09914a-4be9-4d63-8b48-276c53615a99-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:02:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Acquiring lock "cinder-quobyte-3f09914a-4be9-4d63-8b48-276c53615a99" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:02:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Lock "cinder-quobyte-3f09914a-4be9-4d63-8b48-276c53615a99" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:02:24 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef38636a-b3bc-49c1-a807-1684ebee6597]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:02:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:24 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99 Jul 16 11:02:24 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:25 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99" returned: 0 in 0.712s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:25 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99 Jul 16 11:02:25 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:25 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3f09914a-4be9-4d63-8b48-276c53615a99" returned: 0 in 0.628s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Lock "cinder-quobyte-3f09914a-4be9-4d63-8b48-276c53615a99" released by "delete_volume" :: held 1.460s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:02:26 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Created reservations ['0751b345-c156-4552-b408-0da0c850927f', 'cd57bbf0-96b0-4dd7-9851-0354dd3e3d56', '2b8348ed-2b0d-4cb7-ad4e-c5459da3af28', '07934180-a7b6-4eb0-9f76-238b9e53a6cc'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:02:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:02:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:02:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:26 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:02:26 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:26 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.744s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:26 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:02:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Deleted volume successfully. Jul 16 11:02:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2c9097ac-a7a3-45e8-8f51-5ee577592885 tempest-ServerRescueNegativeTestJSON-26001045 None] Lock "cinder-3f09914a-4be9-4d63-8b48-276c53615a99-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:02:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:02:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:02:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:02:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:34 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:02:34 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:34 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.352s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:02:36 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=16,cinder:SELECT=12,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:02:36 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=21,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:02:42 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:02:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Flow 'volume_create_manager' (2025bcea-9f57-4408-ab17-453062b4ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:02:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38a565c-88f3-42d1-aeff-dad1bf1434f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38a565c-88f3-42d1-aeff-dad1bf1434f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2083422871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a16fa62-3e34-4313-81e3-4ee31807925a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822b897831fb42c3afceb1bf3a85d197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:02:43Z,use_quota=True,user_id='0ef79ac9f15746ab9c9ede7bbb25d27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d8a2ba-a164-4289-b5bf-8c08c626c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d8a2ba-a164-4289-b5bf-8c08c626c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83a5187-8fe8-43e1-9d3d-9ff3c2791970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83a5187-8fe8-43e1-9d3d-9ff3c2791970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a16fa62-3e34-4313-81e3-4ee31807925a', 'volume_name': 'volume-4a16fa62-3e34-4313-81e3-4ee31807925a', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09547323-a892-4d99-a176-bf34540f3a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09547323-a892-4d99-a176-bf34540f3a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43bcdfc-d4a8-413d-bf60-b10ec9417131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:43 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Volume 4a16fa62-3e34-4313-81e3-4ee31807925a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a16fa62-3e34-4313-81e3-4ee31807925a', 'volume_size': 1} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2083422871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a16fa62-3e34-4313-81e3-4ee31807925a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822b897831fb42c3afceb1bf3a85d197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:02:43Z,use_quota=True,user_id='0ef79ac9f15746ab9c9ede7bbb25d27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Creating volume 4a16fa62-3e34-4313-81e3-4ee31807925a {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:02:43 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:43 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a 1073741824 Jul 16 11:02:43 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:43 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a 1073741824" returned: 0 in 0.706s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:43 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a Jul 16 11:02:43 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:44 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a" returned: 0 in 0.367s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:02:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43bcdfc-d4a8-413d-bf60-b10ec9417131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a16fa62-3e34-4313-81e3-4ee31807925a', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd024bf9-b215-41dc-b403-d3f0804e3fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:44 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Volume volume-4a16fa62-3e34-4313-81e3-4ee31807925a (4a16fa62-3e34-4313-81e3-4ee31807925a): created successfully Jul 16 11:02:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd024bf9-b215-41dc-b403-d3f0804e3fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Flow 'volume_create_manager' (2025bcea-9f57-4408-ab17-453062b4ebda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:02:44 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-001c2405-944c-435b-aab5-feac65ff6247 tempest-AttachVolumeShelveTestJSON-1569636794 None] Created volume successfully. Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Flow 'volume_create_manager' (a5384167-2e01-4e55-bdb5-134b48984d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11243fd4-1fd8-49c2-8af5-01bb0b9fd24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11243fd4-1fd8-49c2-8af5-01bb0b9fd24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2142524428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae062584-23da-465d-a000-e92de2681453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d230ff417dc424dbc2348b6e339a949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:02:49Z,use_quota=True,user_id='f1ffb087038c48d2a8f2ab8cf660a37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d586dd11-d706-49e1-8cfd-2114b1ab5b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d586dd11-d706-49e1-8cfd-2114b1ab5b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7086274-0585-4082-9e64-61235c4396a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7086274-0585-4082-9e64-61235c4396a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae062584-23da-465d-a000-e92de2681453', 'volume_name': 'volume-ae062584-23da-465d-a000-e92de2681453', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12305d8-c25f-4502-8877-0b0650895d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12305d8-c25f-4502-8877-0b0650895d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42939539-90d6-498b-8507-3258fe68804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:48 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Volume ae062584-23da-465d-a000-e92de2681453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae062584-23da-465d-a000-e92de2681453', 'volume_size': 1} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2142524428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae062584-23da-465d-a000-e92de2681453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d230ff417dc424dbc2348b6e339a949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:02:49Z,use_quota=True,user_id='f1ffb087038c48d2a8f2ab8cf660a37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Creating volume ae062584-23da-465d-a000-e92de2681453 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:02:48 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:02:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:48 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453 1073741824 Jul 16 11:02:48 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:49 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453 1073741824" returned: 0 in 0.666s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:49 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453 Jul 16 11:02:49 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:49 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:02:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42939539-90d6-498b-8507-3258fe68804b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae062584-23da-465d-a000-e92de2681453', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9e8be7-4670-4c42-be88-1f969f01f86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:49 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Volume volume-ae062584-23da-465d-a000-e92de2681453 (ae062584-23da-465d-a000-e92de2681453): created successfully Jul 16 11:02:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9e8be7-4670-4c42-be88-1f969f01f86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Flow 'volume_create_manager' (a5384167-2e01-4e55-bdb5-134b48984d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:02:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f361a144-cc20-448b-9ca4-ec44e4a9a094 tempest-ServersNegativeTestJSON-2047594193 None] Created volume successfully. Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Flow 'volume_create_manager' (b50d3f3e-9326-41c6-b151-544742527ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5e5a78-94e6-4458-ac84-f89f5f423c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5e5a78-94e6-4458-ac84-f89f5f423c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-799247763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d660bd84-4dec-4c31-a0fa-910535f3d307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d230ff417dc424dbc2348b6e339a949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:02:54Z,use_quota=True,user_id='f1ffb087038c48d2a8f2ab8cf660a37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f780d5ba-c79a-4a37-acd2-0bb6c0b50857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f780d5ba-c79a-4a37-acd2-0bb6c0b50857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d407c3bf-42f1-41e3-88e7-6515b11e7003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d407c3bf-42f1-41e3-88e7-6515b11e7003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd660bd84-4dec-4c31-a0fa-910535f3d307', 'volume_name': 'volume-d660bd84-4dec-4c31-a0fa-910535f3d307', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3666436b-c804-41f4-9988-403e804df8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3666436b-c804-41f4-9988-403e804df8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc44724-3f32-4a6c-a6d0-df2bee88749b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:54 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Volume d660bd84-4dec-4c31-a0fa-910535f3d307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d660bd84-4dec-4c31-a0fa-910535f3d307', 'volume_size': 1} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-799247763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d660bd84-4dec-4c31-a0fa-910535f3d307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d230ff417dc424dbc2348b6e339a949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:02:54Z,use_quota=True,user_id='f1ffb087038c48d2a8f2ab8cf660a37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Creating volume d660bd84-4dec-4c31-a0fa-910535f3d307 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:02:54 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:02:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:54 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307 1073741824 Jul 16 11:02:54 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:54 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-90aa9f67-248d-4bcb-a142-0adad0b5d18c tempest-GroupsV314Test-35583787 None] Group tempest-GroupsV314Test-Group-1971801876: creating Jul 16 11:02:54 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-90aa9f67-248d-4bcb-a142-0adad0b5d18c tempest-GroupsV314Test-35583787 None] Group tempest-GroupsV314Test-Group-1971801876: created successfully Jul 16 11:02:54 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-90aa9f67-248d-4bcb-a142-0adad0b5d18c tempest-GroupsV314Test-35583787 None] Create group completed successfully. Jul 16 11:02:55 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307 1073741824" returned: 0 in 0.610s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:55 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307 Jul 16 11:02:55 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:55 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307" returned: 0 in 0.436s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:02:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc44724-3f32-4a6c-a6d0-df2bee88749b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d660bd84-4dec-4c31-a0fa-910535f3d307', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e89eee-5238-435e-bc0c-351e28816154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:55 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Volume volume-d660bd84-4dec-4c31-a0fa-910535f3d307 (d660bd84-4dec-4c31-a0fa-910535f3d307): created successfully Jul 16 11:02:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e89eee-5238-435e-bc0c-351e28816154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Flow 'volume_create_manager' (b50d3f3e-9326-41c6-b151-544742527ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:02:55 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-713c723c-aeb5-461d-8d50-bddcaf9eba97 tempest-ServersNegativeTestJSON-2047594193 None] Created volume successfully. Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Flow 'volume_create_manager' (c87df062-d00f-4e85-b424-de4db3b554e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93a8d2c-8b2e-4d83-90e2-895de10ee6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93a8d2c-8b2e-4d83-90e2-895de10ee6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537447084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a1d82b3-f82d-4550-a015-35a856ba6ba9,host='devstack@QuobyteHD#QuobyteHD',id=800d7448-738d-4c5d-ae2c-73cc58cb3841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ade0b9315441eca11e345cde4ab46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:02:57Z,use_quota=True,user_id='e0e436b770144dc39d36760bcbc33f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92176208-3cf2-4c06-a71a-d4ff86fd73e0),volume_type_id=92176208-3cf2-4c06-a71a-d4ff86fd73e0)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1039edc-3b56-4608-8021-2055de5f9048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1039edc-3b56-4608-8021-2055de5f9048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b40a82a-d0f2-45c9-8013-c7e244377e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b40a82a-d0f2-45c9-8013-c7e244377e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800d7448-738d-4c5d-ae2c-73cc58cb3841', 'volume_name': 'volume-800d7448-738d-4c5d-ae2c-73cc58cb3841', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628e3032-c603-4f92-a1e6-6c5b7199ef55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628e3032-c603-4f92-a1e6-6c5b7199ef55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe30e9f-6ca7-4860-81f2-dbbc62b372dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:57 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Volume 800d7448-738d-4c5d-ae2c-73cc58cb3841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800d7448-738d-4c5d-ae2c-73cc58cb3841', 'volume_size': 1} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8a1d82b3-f82d-4550-a015-35a856ba6ba9,created_at=2026-07-16T09:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537447084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a1d82b3-f82d-4550-a015-35a856ba6ba9,host='devstack@QuobyteHD#QuobyteHD',id=800d7448-738d-4c5d-ae2c-73cc58cb3841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ade0b9315441eca11e345cde4ab46a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:02:57Z,use_quota=True,user_id='e0e436b770144dc39d36760bcbc33f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92176208-3cf2-4c06-a71a-d4ff86fd73e0),volume_type_id=92176208-3cf2-4c06-a71a-d4ff86fd73e0)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Creating volume 800d7448-738d-4c5d-ae2c-73cc58cb3841 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:02:57 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:57 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 1073741824 Jul 16 11:02:57 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Acquiring lock "cinder-d660bd84-4dec-4c31-a0fa-910535f3d307-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Lock "cinder-d660bd84-4dec-4c31-a0fa-910535f3d307-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Acquiring lock "cinder-quobyte-d660bd84-4dec-4c31-a0fa-910535f3d307" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Lock "cinder-quobyte-d660bd84-4dec-4c31-a0fa-910535f3d307" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa250a75-404a-432d-858a-651a18931c87]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:57 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307 Jul 16 11:02:57 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:57 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 1073741824" returned: 0 in 0.507s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:57 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 Jul 16 11:02:57 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:57 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307" returned: 0 in 0.444s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:57 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307 Jul 16 11:02:57 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:58 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841" returned: 0 in 0.269s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe30e9f-6ca7-4860-81f2-dbbc62b372dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800d7448-738d-4c5d-ae2c-73cc58cb3841', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72521655-2e85-4630-95c8-2fead5e7b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:02:58 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Volume volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 (800d7448-738d-4c5d-ae2c-73cc58cb3841): created successfully Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72521655-2e85-4630-95c8-2fead5e7b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Flow 'volume_create_manager' (c87df062-d00f-4e85-b424-de4db3b554e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:02:58 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-567fc7e7-8832-4392-b033-8b3b81af494c tempest-GroupsV314Test-35583787 None] Created volume successfully. Jul 16 11:02:58 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d660bd84-4dec-4c31-a0fa-910535f3d307" returned: 0 in 0.318s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Lock "cinder-quobyte-d660bd84-4dec-4c31-a0fa-910535f3d307" released by "delete_volume" :: held 0.812s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Created reservations ['811c3291-dfe1-4f39-b58d-469dae1737f8', '6a2a80b9-9f6b-429a-9f62-35114214f43e', 'afce7b87-382b-4505-a4df-4ce4b303a531', 'e4de6fce-cac1-469e-ad2b-a90941ff0b70'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:58 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:02:58 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Acquiring lock "cinder-ae062584-23da-465d-a000-e92de2681453-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Lock "cinder-ae062584-23da-465d-a000-e92de2681453-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Acquiring lock "cinder-quobyte-ae062584-23da-465d-a000-e92de2681453" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Lock "cinder-quobyte-ae062584-23da-465d-a000-e92de2681453" acquired by "delete_volume" :: waited 0.042s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:02:58 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.364s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:02:58 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Deleted volume successfully. Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de126e9-c0fa-4f6d-a332-28e4f3481f72]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f549d8a7-42ea-498e-95ad-00fff40ca574 tempest-ServersNegativeTestJSON-2047594193 None] Lock "cinder-d660bd84-4dec-4c31-a0fa-910535f3d307-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:02:58 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453 Jul 16 11:02:58 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:59 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453" returned: 0 in 0.465s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:59 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453 Jul 16 11:02:59 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-f77dc3c6-2150-4461-ac1c-e0b4a4a1ac0e req-24d09ed6-aa98-4dc7-ac58-5dd9093e1da6 tempest-AttachVolumeShelveTestJSON-1569636794 None] No connector for attachment 1a38d866-a350-41db-b5bf-23757f879535; skipping storage backend terminate_connection call. {{(pid=87345) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-f77dc3c6-2150-4461-ac1c-e0b4a4a1ac0e req-24d09ed6-aa98-4dc7-ac58-5dd9093e1da6 tempest-AttachVolumeShelveTestJSON-1569636794 None] Deleting attachment 1a38d866-a350-41db-b5bf-23757f879535. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:59 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Cloning volume 800d7448-738d-4c5d-ae2c-73cc58cb3841 to volume 1dcae0be-1a21-40f8-a801-892a4d55434a Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Creating offline snapshot 43f8612b-0bf8-44ef-895a-baf8b7b4f00b of volume 800d7448-738d-4c5d-ae2c-73cc58cb3841 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[50315caf-a7bc-4b0b-b98f-4a8b085286b9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:59 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae062584-23da-465d-a000-e92de2681453" returned: 0 in 0.303s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Lock "cinder-quobyte-ae062584-23da-465d-a000-e92de2681453" released by "delete_volume" :: held 0.844s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:02:59 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 Jul 16 11:02:59 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Created reservations ['bd966c26-04aa-4487-b62c-8207d3ddcbac', '6ef205c1-424e-4884-9eb0-7fe0d77231e5', 'e683d676-ccd8-479d-bb85-f8fe0f5dd05b', '7348f7bc-dd49-4b31-aeb7-e9b098977cc1'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:59 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:02:59 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:02:59 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841" returned: 0 in 0.439s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:02:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:02:59 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b 1G Jul 16 11:02:59 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:00 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.394s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:00 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:03:00 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Deleted volume successfully. Jul 16 11:03:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72a51cd0-0b8b-4516-adf1-4d29fa9d2571 tempest-ServersNegativeTestJSON-2047594193 None] Lock "cinder-ae062584-23da-465d-a000-e92de2681453-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:00 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b 1G" returned: 0 in 0.592s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:00 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b Jul 16 11:03:00 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:01 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b" returned: 0 in 0.529s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:01 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:03:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:01 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b Jul 16 11:03:01 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:01 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b" returned: 0 in 0.285s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:01 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.info Jul 16 11:03:01 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:01 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.info" returned: 0 in 0.321s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:01 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:03:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:01 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.info Jul 16 11:03:01 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:02 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.info" returned: 0 in 0.451s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Acquiring lock "cinder-quobyte-1dcae0be-1a21-40f8-a801-892a4d55434a" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Lock "cinder-quobyte-1dcae0be-1a21-40f8-a801-892a4d55434a" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] snapshot: 43f8612b-0bf8-44ef-895a-baf8b7b4f00b, volume: 1dcae0be-1a21-40f8-a801-892a4d55434a, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[67148d60-c3eb-41c6-920f-3504fd780002]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:02 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b Jul 16 11:03:02 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:02 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b" returned: 0 in 0.489s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800d7448-738d-4c5d-ae2c-73cc58cb3841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d397ed0-86ce-4c39-9566-d42817b5de17]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:02 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 Jul 16 11:03:02 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:03 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841" returned: 0 in 0.567s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:03 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:03:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:03 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a Jul 16 11:03:03 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:09 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a" returned: 0 in 5.948s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:09 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[db625ddf-c3bb-48ab-abf1-613441d844bc]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:09 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 Jul 16 11:03:09 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:09 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841" returned: 0 in 0.590s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:09 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:03:09 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Converted 1024.00 MB image at 172.06 MB/s Jul 16 11:03:09 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:03:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:09 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a Jul 16 11:03:09 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:10 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a" returned: 0 in 0.271s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Lock "cinder-quobyte-1dcae0be-1a21-40f8-a801-892a4d55434a" released by "_copy_volume_from_snapshot" :: held 7.990s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Acquiring lock "cinder-quobyte-43f8612b-0bf8-44ef-895a-baf8b7b4f00b" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Lock "cinder-quobyte-43f8612b-0bf8-44ef-895a-baf8b7b4f00b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Deleting offline snapshot 43f8612b-0bf8-44ef-895a-baf8b7b4f00b of volume 800d7448-738d-4c5d-ae2c-73cc58cb3841 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] snapshot_file for this snap is: volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c08e49e-3319-4f05-b1f0-72100b3b2cea]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:10 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b Jul 16 11:03:10 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:10 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b" returned: 0 in 0.548s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800d7448-738d-4c5d-ae2c-73cc58cb3841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[160aa67b-cd74-4226-b0b1-9e84eb777e5b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:11 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 Jul 16 11:03:11 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:11 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=28,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:03:11 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841" returned: 0 in 0.494s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:11 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b Jul 16 11:03:11 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:12 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b" returned: 0 in 0.783s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:12 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b Jul 16 11:03:12 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:12 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841.43f8612b-0bf8-44ef-895a-baf8b7b4f00b" returned: 0 in 0.642s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Lock "cinder-quobyte-43f8612b-0bf8-44ef-895a-baf8b7b4f00b" released by "_delete_snapshot" :: held 2.672s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.605s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:13 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-325226b2-bf0c-4a50-9ffd-2004d17e7875 tempest-GroupsV314Test-35583787 None] Create group from source-group-8a1d82b3-f82d-4550-a015-35a856ba6ba9 completed successfully. Jul 16 11:03:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Acquiring lock "cinder-quobyte-1dcae0be-1a21-40f8-a801-892a4d55434a" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Lock "cinder-quobyte-1dcae0be-1a21-40f8-a801-892a4d55434a" acquired by "delete_volume" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:15 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[717778dc-70eb-49e6-b145-769601ee1de5]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:15 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a Jul 16 11:03:15 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:16 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a" returned: 0 in 0.893s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:16 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a Jul 16 11:03:16 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:16 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1dcae0be-1a21-40f8-a801-892a4d55434a" returned: 0 in 0.510s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Lock "cinder-quobyte-1dcae0be-1a21-40f8-a801-892a4d55434a" released by "delete_volume" :: held 1.511s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:16 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Created reservations ['152d1421-780d-489b-8fe9-f695426e68fe'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:03:17 devstack cinder-volume[87345]: WARNING cinder.quota [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1324370644 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1324370644, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:03:17 devstack cinder-volume[87345]: WARNING cinder.quota [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1324370644 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1324370644, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:03:17 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Created reservations ['ab6243c2-cccb-458a-967d-da779b0cf792', 'c20c5876-0d7d-49e3-bc0a-22612948ad08', 'f07e6803-b18d-4bf3-b12f-83df2cb9a758', 'ea2ce984-72d3-424b-adf7-cccc0ce9a4fd'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:03:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:17 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:03:17 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:17 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.527s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:17 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:03:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-dc6319f6-3620-4c21-bcc5-f7e7c71c08ab tempest-GroupsV314Test-35583787 None] Delete group completed successfully. Jul 16 11:03:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Acquiring lock "cinder-quobyte-800d7448-738d-4c5d-ae2c-73cc58cb3841" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Lock "cinder-quobyte-800d7448-738d-4c5d-ae2c-73cc58cb3841" acquired by "delete_volume" :: waited 0.036s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:18 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[095379d2-b088-4f61-97dc-09c46287ca69]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:18 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 Jul 16 11:03:18 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:18 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Flow 'volume_create_manager' (b088df87-535d-4b58-82fc-d22b5ebb14a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053df6ea-1fd7-4e2a-8fcc-01945fb0e9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053df6ea-1fd7-4e2a-8fcc-01945fb0e9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-479925180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9d999a-91ac-43a0-a1c9-c2bba7a382fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f55c05a11d3543be903abe17506c0013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:03:19Z,use_quota=True,user_id='f9bdf0749ad2474f96923edd7e2a8a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b94049-d553-4a02-b884-25d10d0e5de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b94049-d553-4a02-b884-25d10d0e5de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde2f26a-0c4a-44bf-9113-a318588515b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde2f26a-0c4a-44bf-9113-a318588515b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9d999a-91ac-43a0-a1c9-c2bba7a382fb', 'volume_name': 'volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65da9a5-aa83-42c6-ba0e-6c069e144d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65da9a5-aa83-42c6-ba0e-6c069e144d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7536222c-22b7-4688-9176-fdeec7f9f400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:19 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Volume 1b9d999a-91ac-43a0-a1c9-c2bba7a382fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb', 'volume_size': 1} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-479925180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9d999a-91ac-43a0-a1c9-c2bba7a382fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f55c05a11d3543be903abe17506c0013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:03:19Z,use_quota=True,user_id='f9bdf0749ad2474f96923edd7e2a8a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Creating volume 1b9d999a-91ac-43a0-a1c9-c2bba7a382fb {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:03:19 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:19 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb 1073741824 Jul 16 11:03:19 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:19 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841" returned: 0 in 0.837s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:19 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841 Jul 16 11:03:19 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:19 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-800d7448-738d-4c5d-ae2c-73cc58cb3841" returned: 0 in 0.464s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Lock "cinder-quobyte-800d7448-738d-4c5d-ae2c-73cc58cb3841" released by "delete_volume" :: held 1.437s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:19 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb 1073741824" returned: 0 in 0.778s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:20 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb Jul 16 11:03:20 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Created reservations ['f2140b75-49ab-4ce1-bcda-520ee1326c91'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Created reservations ['53a2c9a7-e665-4edc-b0a0-8b7f06e295e5', 'bdc208da-e7d5-47a5-aa00-b1955cec62f3', 'd4279591-3ae3-433e-b8cc-806229a1e3b2', '37ed0bca-32a2-4548-a7ba-6bce76c043ee'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:03:20 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb" returned: 0 in 0.574s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7536222c-22b7-4688-9176-fdeec7f9f400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4b684a-6049-4291-8d30-8cb027a7d850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:20 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Volume volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb (1b9d999a-91ac-43a0-a1c9-c2bba7a382fb): created successfully Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4b684a-6049-4291-8d30-8cb027a7d850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Flow 'volume_create_manager' (b088df87-535d-4b58-82fc-d22b5ebb14a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ded7fdd2-fdfc-48fc-8d6e-f7f0b9bbf6c4 tempest-VolumesTestJSON-2032353608 None] Created volume successfully. Jul 16 11:03:20 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:03:20 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:21 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.775s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:21 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:03:21 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f98a5fee-9bdf-4325-ba03-b6957b537407 tempest-GroupsV314Test-35583787 None] Delete group completed successfully. Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Flow 'volume_create_manager' (380faeb8-0a00-45fe-bdb5-fb35d596ffcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337db52e-06bb-4c0b-a602-853ea551db33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337db52e-06bb-4c0b-a602-853ea551db33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-369582889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f55c05a11d3543be903abe17506c0013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:03:22Z,use_quota=True,user_id='f9bdf0749ad2474f96923edd7e2a8a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f6f698-ad18-46f5-ba3a-ecc5428f0c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f6f698-ad18-46f5-ba3a-ecc5428f0c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0603a3e5-b448-4898-951f-72bf6d1b33ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0603a3e5-b448-4898-951f-72bf6d1b33ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6', 'volume_name': 'volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c4d4ff-cfea-42ce-b2e8-1044bdbed76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c4d4ff-cfea-42ce-b2e8-1044bdbed76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30a4619-841f-4e07-9ee2-fdf78a1ad05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:22 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Volume 8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6', 'volume_size': 1} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-369582889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f55c05a11d3543be903abe17506c0013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:03:22Z,use_quota=True,user_id='f9bdf0749ad2474f96923edd7e2a8a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Creating volume 8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:03:22 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:03:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:22 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6 1073741824 Jul 16 11:03:22 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:23 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6 1073741824" returned: 0 in 0.613s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:23 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6 Jul 16 11:03:23 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:23 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6" returned: 0 in 0.352s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:03:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30a4619-841f-4e07-9ee2-fdf78a1ad05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6242ca55-2d42-4295-a85e-ded96ee3b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:23 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Volume volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6 (8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6): created successfully Jul 16 11:03:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6242ca55-2d42-4295-a85e-ded96ee3b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Flow 'volume_create_manager' (380faeb8-0a00-45fe-bdb5-fb35d596ffcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:03:23 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a004fd7d-4d93-4efb-a4b0-05ea9e7208b8 tempest-VolumesTestJSON-2032353608 None] Created volume successfully. Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Flow 'volume_create_manager' (a2a0faf1-43f4-4236-8869-fdefe515c47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d088e2-7dad-49ab-879f-6174bc8a5008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d088e2-7dad-49ab-879f-6174bc8a5008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1215297855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f707a9-69c0-429f-8907-73f6cbb9c5e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f55c05a11d3543be903abe17506c0013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:03:25Z,use_quota=True,user_id='f9bdf0749ad2474f96923edd7e2a8a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6c7ec1-9f4f-4044-998c-a629f5e27a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6c7ec1-9f4f-4044-998c-a629f5e27a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa9b88b-91d8-4a7d-b570-3810aaf2d3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa9b88b-91d8-4a7d-b570-3810aaf2d3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f707a9-69c0-429f-8907-73f6cbb9c5e1', 'volume_name': 'volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3503da90-fcb1-4928-83d0-ebf80aede46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3503da90-fcb1-4928-83d0-ebf80aede46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12b15b1-a907-4ae5-90d5-52d1ef783cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:25 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Volume 43f707a9-69c0-429f-8907-73f6cbb9c5e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1', 'volume_size': 1} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1215297855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f707a9-69c0-429f-8907-73f6cbb9c5e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f55c05a11d3543be903abe17506c0013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:03:25Z,use_quota=True,user_id='f9bdf0749ad2474f96923edd7e2a8a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Creating volume 43f707a9-69c0-429f-8907-73f6cbb9c5e1 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:03:25 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:25 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1 1073741824 Jul 16 11:03:25 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:25 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1 1073741824" returned: 0 in 0.544s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:25 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1 Jul 16 11:03:25 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:26 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1" returned: 0 in 0.354s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:03:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12b15b1-a907-4ae5-90d5-52d1ef783cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc9f8bf-e616-4cc8-9fc8-c633fe7789c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:26 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Volume volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1 (43f707a9-69c0-429f-8907-73f6cbb9c5e1): created successfully Jul 16 11:03:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc9f8bf-e616-4cc8-9fc8-c633fe7789c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Flow 'volume_create_manager' (a2a0faf1-43f4-4236-8869-fdefe515c47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:03:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-30ce59ed-6038-48ca-b1ba-065f1df27fea tempest-VolumesTestJSON-2032353608 None] Created volume successfully. Jul 16 11:03:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Acquiring lock "cinder-43f707a9-69c0-429f-8907-73f6cbb9c5e1-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Lock "cinder-43f707a9-69c0-429f-8907-73f6cbb9c5e1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Acquiring lock "cinder-quobyte-43f707a9-69c0-429f-8907-73f6cbb9c5e1" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Lock "cinder-quobyte-43f707a9-69c0-429f-8907-73f6cbb9c5e1" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-233c4d7e-df0d-4f51-afd1-372a65fff6f4 tempest-GroupsV320Test-1473152171 None] Group tempest-GroupsV320Test-Group-576816186: creating Jul 16 11:03:28 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b70f50-a78a-4fb7-b88d-65787bd4845e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-233c4d7e-df0d-4f51-afd1-372a65fff6f4 tempest-GroupsV320Test-1473152171 None] Group tempest-GroupsV320Test-Group-576816186: created successfully Jul 16 11:03:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-233c4d7e-df0d-4f51-afd1-372a65fff6f4 tempest-GroupsV320Test-1473152171 None] Create group completed successfully. Jul 16 11:03:28 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1 Jul 16 11:03:28 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:28 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1" returned: 0 in 0.383s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:29 devstack sudo[90975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1 Jul 16 11:03:29 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:29 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43f707a9-69c0-429f-8907-73f6cbb9c5e1" returned: 0 in 0.240s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Lock "cinder-quobyte-43f707a9-69c0-429f-8907-73f6cbb9c5e1" released by "delete_volume" :: held 0.683s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Created reservations ['2d09deb5-6c40-4b30-ae97-1321c8c01971', '903d442f-78d8-4296-b5b9-7af3829ebe58', '43b6bd44-787b-4e07-ada0-405f2223f521', '09decd63-987c-4868-ba77-684658360b31'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:29 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:03:29 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:29 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Acquiring lock "cinder-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.267s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:03:29 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Deleted volume successfully. Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Lock "cinder-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ba6afbd0-633b-45be-a4e8-f72ac16ea77c tempest-VolumesTestJSON-2032353608 None] Lock "cinder-43f707a9-69c0-429f-8907-73f6cbb9c5e1-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Acquiring lock "cinder-quobyte-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Lock "cinder-quobyte-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[28068cba-b394-4405-80d2-ee696531edd2]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:29 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6 Jul 16 11:03:29 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:30 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6" returned: 0 in 0.389s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:30 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6 Jul 16 11:03:30 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-9bae503c-fb0c-403c-a63c-714f4c781dfa tempest-GroupsV320Test-1473152171 None] Created reservations ['61529b2b-3a34-4421-90b5-6dcea79e56f0'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9bae503c-fb0c-403c-a63c-714f4c781dfa tempest-GroupsV320Test-1473152171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9bae503c-fb0c-403c-a63c-714f4c781dfa tempest-GroupsV320Test-1473152171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9bae503c-fb0c-403c-a63c-714f4c781dfa tempest-GroupsV320Test-1473152171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9bae503c-fb0c-403c-a63c-714f4c781dfa tempest-GroupsV320Test-1473152171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9bae503c-fb0c-403c-a63c-714f4c781dfa tempest-GroupsV320Test-1473152171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9bae503c-fb0c-403c-a63c-714f4c781dfa tempest-GroupsV320Test-1473152171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:30 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:03:30 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:30 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6" returned: 0 in 0.275s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Lock "cinder-quobyte-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6" released by "delete_volume" :: held 0.716s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Created reservations ['fcebda04-def7-473c-97c5-6b422619256d', 'bbf5de98-4bc4-4985-a1e4-9ebeead1be82', 'f1660601-84a2-4d73-8518-0b73806aa13f', '7d5b460d-88f0-4afb-adb7-88acb5a2fa9c'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:03:30 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9bae503c-fb0c-403c-a63c-714f4c781dfa tempest-GroupsV320Test-1473152171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.263s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-9bae503c-fb0c-403c-a63c-714f4c781dfa tempest-GroupsV320Test-1473152171 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:30 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9bae503c-fb0c-403c-a63c-714f4c781dfa tempest-GroupsV320Test-1473152171 None] Delete group completed successfully. Jul 16 11:03:30 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:03:30 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Acquiring lock "cinder-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Lock "cinder-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:30 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.285s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:03:30 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Deleted volume successfully. Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Acquiring lock "cinder-quobyte-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Lock "cinder-quobyte-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9fa568-7b82-49f1-8c1d-22cac0534c49 tempest-VolumesTestJSON-2032353608 None] Lock "cinder-8b61cf05-f05e-4df7-9d9b-d573e8c0ebe6-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea88bc8-54bd-4805-b880-afc99f916b47]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:31 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb Jul 16 11:03:31 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:31 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb" returned: 0 in 0.374s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:31 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb Jul 16 11:03:31 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:31 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb" returned: 0 in 0.279s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Lock "cinder-quobyte-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb" released by "delete_volume" :: held 0.710s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:31 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Created reservations ['58c59012-d835-4513-84e7-e30107773434', 'b8fa9f5c-e695-4b65-8132-5891961cb7c4', 'a989b0e7-f696-4c14-b27a-5aa2a14f8d1f', '226d6ca4-4ffa-415b-a2e2-49b82deb7179'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:03:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:31 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:03:31 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:32 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.292s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:32 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:03:32 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Deleted volume successfully. Jul 16 11:03:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41440ecb-7137-4187-8831-802f84ccf908 tempest-VolumesTestJSON-2032353608 None] Lock "cinder-1b9d999a-91ac-43a0-a1c9-c2bba7a382fb-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:03:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:34 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:03:34 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:35 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.438s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:03:35 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:03:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 8 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:03:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:03:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f6300f2-bd1a-4ef4-9c29-f298dd0f8e26 tempest-BackendsCapabilitiesAdminTestsJSON-747106307 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87345) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 16 11:03:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5dffc984-691c-42f9-91af-4399758a5c40 tempest-BackendsCapabilitiesAdminTestsJSON-747106307 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87345) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=71,cinder:UPDATE=94,cinder:INSERT=19,cinder:DELETE=7 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Flow 'volume_create_manager' (aaaca12e-0bb1-4201-8b9e-0ebab6f12f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47f18e6-ffa6-44d4-843f-1fe96bdddc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47f18e6-ffa6-44d4-843f-1fe96bdddc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-699729717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fbdb83-e6ba-4268-8825-716bde402f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f767bdebf4d0f8b4f7cba167b2f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:03:38Z,use_quota=True,user_id='317ff662404e4464b02f582b34718772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7253acd-6a08-45b1-8bc3-d8fd7db0582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7253acd-6a08-45b1-8bc3-d8fd7db0582a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea48fecb-1511-4645-a7b1-42deab9a6a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea48fecb-1511-4645-a7b1-42deab9a6a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65fbdb83-e6ba-4268-8825-716bde402f67', 'volume_name': 'volume-65fbdb83-e6ba-4268-8825-716bde402f67', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdb25bd-d6c4-4ed3-a671-7f7870fb3f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdb25bd-d6c4-4ed3-a671-7f7870fb3f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada7bb46-cd42-4976-afe9-69d5b5ca7805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:37 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Volume 65fbdb83-e6ba-4268-8825-716bde402f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65fbdb83-e6ba-4268-8825-716bde402f67', 'volume_size': 1} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-699729717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fbdb83-e6ba-4268-8825-716bde402f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f767bdebf4d0f8b4f7cba167b2f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:03:38Z,use_quota=True,user_id='317ff662404e4464b02f582b34718772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Creating volume 65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:03:37 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:03:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:37 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 1073741824 Jul 16 11:03:37 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:38 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 1073741824" returned: 0 in 0.531s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:38 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 Jul 16 11:03:38 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:38 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67" returned: 0 in 0.319s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada7bb46-cd42-4976-afe9-69d5b5ca7805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65fbdb83-e6ba-4268-8825-716bde402f67', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b19229-d6a9-463e-b1b6-6641c9c22127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Volume volume-65fbdb83-e6ba-4268-8825-716bde402f67 (65fbdb83-e6ba-4268-8825-716bde402f67): created successfully Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b19229-d6a9-463e-b1b6-6641c9c22127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Flow 'volume_create_manager' (aaaca12e-0bb1-4201-8b9e-0ebab6f12f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:03:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9c8519c5-77b7-46f7-8ee0-84e802ea82af tempest-SnapshotsActionsTest-667819603 None] Created volume successfully. Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Flow 'volume_create_manager' (238a0b73-5386-4a06-821e-abe04eab75bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5878787e-73ca-4f3f-86d8-d672e686efbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5878787e-73ca-4f3f-86d8-d672e686efbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-350714345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c56386-59af-48cb-aaf8-ef548c123bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923ddf6348914443991d72ead38de312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:03:39Z,use_quota=True,user_id='60b56094528b4dd7b357b2c5d6fa7bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbae411-286d-4dce-9b61-91d20bc0e03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbae411-286d-4dce-9b61-91d20bc0e03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005be3bd-8b69-45c7-9f62-da6a4a02ccad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005be3bd-8b69-45c7-9f62-da6a4a02ccad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c56386-59af-48cb-aaf8-ef548c123bcc', 'volume_name': 'volume-40c56386-59af-48cb-aaf8-ef548c123bcc', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946cf959-9091-4df0-8079-24cb68eb4c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946cf959-9091-4df0-8079-24cb68eb4c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20519283-3ebd-42d2-a5a7-6c9cfd47b746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Volume 40c56386-59af-48cb-aaf8-ef548c123bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c56386-59af-48cb-aaf8-ef548c123bcc', 'volume_size': 1} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-350714345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c56386-59af-48cb-aaf8-ef548c123bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923ddf6348914443991d72ead38de312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:03:39Z,use_quota=True,user_id='60b56094528b4dd7b357b2c5d6fa7bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Creating volume 40c56386-59af-48cb-aaf8-ef548c123bcc {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:03:38 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:03:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:38 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc 1073741824 Jul 16 11:03:38 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:39 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc 1073741824" returned: 0 in 0.609s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:39 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc Jul 16 11:03:39 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:39 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc" returned: 0 in 0.347s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:03:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20519283-3ebd-42d2-a5a7-6c9cfd47b746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c56386-59af-48cb-aaf8-ef548c123bcc', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad497ab9-a50d-4710-ac34-e123956163c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:03:39 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Volume volume-40c56386-59af-48cb-aaf8-ef548c123bcc (40c56386-59af-48cb-aaf8-ef548c123bcc): created successfully Jul 16 11:03:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad497ab9-a50d-4710-ac34-e123956163c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:03:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Flow 'volume_create_manager' (238a0b73-5386-4a06-821e-abe04eab75bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:03:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a0fbd836-75fc-4354-bfc8-f1de5927300e tempest-ServerActionsTestOtherA-315179138 None] Created volume successfully. Jul 16 11:03:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] Creating offline snapshot 4b29794e-7c79-4b39-a7e9-cd09363815ee of volume 65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:03:40 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[225f4688-1bde-4f70-9f10-a11a59ad9548]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:40 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 Jul 16 11:03:40 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:40 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67" returned: 0 in 0.382s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:40 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee 1G Jul 16 11:03:40 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:41 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee 1G" returned: 0 in 0.474s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:41 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:03:41 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:41 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.335s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:41 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee is being set with open permissions: ugo+rw Jul 16 11:03:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:41 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:03:41 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:41 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.268s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:41 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.info Jul 16 11:03:41 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:42 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.info" returned: 0 in 0.287s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:42 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.info is being set with open permissions: ugo+rw Jul 16 11:03:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:42 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.info Jul 16 11:03:42 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:42 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.info" returned: 0 in 0.277s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:42 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f8b335fa-b673-420c-adbb-0fd7c20cb976 tempest-SnapshotsActionsTest-667819603 None] Create snapshot completed successfully Jul 16 11:03:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] Creating offline snapshot af8162f6-6567-4a03-824c-5a15f4c06fdb of volume 65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:03:44 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7e1587-67a9-4e55-805b-4e804692425b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:44 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:03:44 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:45 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.744s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:03:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:45 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb 1G Jul 16 11:03:45 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:45 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb 1G" returned: 0 in 0.674s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:45 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb Jul 16 11:03:45 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:46 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb" returned: 0 in 0.365s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:46 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb is being set with open permissions: ugo+rw Jul 16 11:03:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:46 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb Jul 16 11:03:46 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:46 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb" returned: 0 in 0.301s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.230s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:46 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8723cebd-09e7-4e20-a85d-f8695e80de56 tempest-SnapshotsActionsTest-667819603 None] Create snapshot completed successfully Jul 16 11:03:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-af8162f6-6567-4a03-824c-5a15f4c06fdb-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-af8162f6-6567-4a03-824c-5a15f4c06fdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-quobyte-af8162f6-6567-4a03-824c-5a15f4c06fdb" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-af8162f6-6567-4a03-824c-5a15f4c06fdb" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Deleting offline snapshot af8162f6-6567-4a03-824c-5a15f4c06fdb of volume 65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:03:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] snapshot_file for this snap is: volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:03:48 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afcc870-85e6-40aa-9819-04582dc509d3]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:48 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb Jul 16 11:03:48 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:48 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb" returned: 0 in 0.672s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:48 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:03:48 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe74dace-51f2-4f71-9c44-939dd0f29996]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:48 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:03:48 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:49 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.545s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:03:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:49 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb Jul 16 11:03:49 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:49 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb" returned: 0 in 0.677s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:50 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb Jul 16 11:03:50 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Acquiring lock "cinder-4a16fa62-3e34-4313-81e3-4ee31807925a-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Lock "cinder-4a16fa62-3e34-4313-81e3-4ee31807925a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Acquiring lock "cinder-quobyte-4a16fa62-3e34-4313-81e3-4ee31807925a" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Lock "cinder-quobyte-4a16fa62-3e34-4313-81e3-4ee31807925a" acquired by "delete_volume" :: waited 0.035s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[376fb37d-0a3c-463f-a818-1b79d7530bff]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:50 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a Jul 16 11:03:50 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:50 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.af8162f6-6567-4a03-824c-5a15f4c06fdb" returned: 0 in 0.508s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-af8162f6-6567-4a03-824c-5a15f4c06fdb" released by "_delete_snapshot" :: held 2.579s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" released by "delete_snapshot" :: held 2.626s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:50 devstack cinder-volume[87345]: WARNING cinder.quota [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Created reservations ['11e67a7b-30a5-432c-9c1f-1264565b43ff', 'd678cd02-d2db-4076-aeee-f719933e026d', 'dfe54d0d-24e2-47c6-873a-5a5456b7db99', '02365f37-3b06-411e-bd56-19f0e3bf8b89'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:03:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Delete snapshot completed successfully. Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50acd266-5e71-49b9-8b1b-192d71a1c65d tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-af8162f6-6567-4a03-824c-5a15f4c06fdb-delete_snapshot" released by "delete_snapshot" :: held 2.838s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:50 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a" returned: 0 in 0.458s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:50 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a Jul 16 11:03:50 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:51 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a16fa62-3e34-4313-81e3-4ee31807925a" returned: 0 in 0.275s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Lock "cinder-quobyte-4a16fa62-3e34-4313-81e3-4ee31807925a" released by "delete_volume" :: held 0.823s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Created reservations ['7bdbef39-1471-497b-85f0-e4d7b1a7941d', '203f3264-fc46-4fbf-9b67-b080aeac6449', '7c61b65d-29ce-4521-bf9d-1a6f7360f008', 'f0a23784-4194-4ca1-8e1d-70512a46009c'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:51 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:03:51 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:51 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.402s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:51 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Deleted volume successfully. Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] Creating offline snapshot 403ce240-cd89-4394-977a-3cd105215531 of volume 65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-257524fa-4dfc-401e-a1b6-2d0bed07fc29 tempest-AttachVolumeShelveTestJSON-1569636794 None] Lock "cinder-4a16fa62-3e34-4313-81e3-4ee31807925a-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f8b261-c1d8-41b8-bf65-aaa7a76b6855]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:51 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:03:51 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:52 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.639s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:03:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:52 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 1G Jul 16 11:03:52 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:53 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 1G" returned: 0 in 0.665s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:53 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 Jul 16 11:03:53 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:53 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531" returned: 0 in 0.611s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:53 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 is being set with open permissions: ugo+rw Jul 16 11:03:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:53 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 Jul 16 11:03:53 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:54 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531" returned: 0 in 0.611s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.767s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:03:54 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5202cae1-cf88-4994-ac17-c145ab8ab2d5 tempest-SnapshotsActionsTest-667819603 None] Create snapshot completed successfully Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-403ce240-cd89-4394-977a-3cd105215531-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-403ce240-cd89-4394-977a-3cd105215531-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-quobyte-403ce240-cd89-4394-977a-3cd105215531" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-403ce240-cd89-4394-977a-3cd105215531" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Deleting offline snapshot 403ce240-cd89-4394-977a-3cd105215531 of volume 65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] snapshot_file for this snap is: volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc4c0fe-2acc-4dc8-ba74-93ef5ea0eb66]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:55 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 Jul 16 11:03:55 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:55 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531" returned: 0 in 0.487s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0a74b7-0b05-462d-b0f9-6ae958347a82]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:55 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:03:55 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:56 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.552s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:03:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:56 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 Jul 16 11:03:56 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:56 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531" returned: 0 in 0.481s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:56 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531 Jul 16 11:03:56 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:56 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.403ce240-cd89-4394-977a-3cd105215531" returned: 0 in 0.283s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-403ce240-cd89-4394-977a-3cd105215531" released by "_delete_snapshot" :: held 1.931s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" released by "delete_snapshot" :: held 1.957s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:57 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Created reservations ['8f4715be-c900-4603-95d8-4c01febcdb6b', '7141e9bf-a074-4f58-8d15-dc9ebcb6100a', '3ccd2577-d58f-4daf-9508-89c2a0eb7baa', '98e953aa-92ec-4fe5-b94d-69b31c3a3a31'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:03:57 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Delete snapshot completed successfully. Jul 16 11:03:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d43e8f7b-e10f-4754-80f2-e59629b6820f tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-403ce240-cd89-4394-977a-3cd105215531-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:03:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:03:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:03:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] Creating offline snapshot 1e85b7cb-de26-4f60-a519-b2d06fe45da3 of volume 65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:03:58 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda243a3-d92f-4793-88b2-8847f84a9690]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:03:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:58 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:03:58 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:59 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.488s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:03:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:59 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 1G Jul 16 11:03:59 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:03:59 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Jul 16 11:03:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 1G" returned: 0 in 0.585s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:03:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:03:59 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 Jul 16 11:03:59 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:00 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3" returned: 0 in 0.472s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:00 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 is being set with open permissions: ugo+rw Jul 16 11:04:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:00 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 Jul 16 11:04:00 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:00 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3" returned: 0 in 0.354s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:00 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8a0ea36a-b7a4-4b2a-8644-a63785402d31 tempest-SnapshotsActionsTest-667819603 None] Create snapshot completed successfully Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-1e85b7cb-de26-4f60-a519-b2d06fe45da3-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-1e85b7cb-de26-4f60-a519-b2d06fe45da3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-quobyte-1e85b7cb-de26-4f60-a519-b2d06fe45da3" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-1e85b7cb-de26-4f60-a519-b2d06fe45da3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Deleting offline snapshot 1e85b7cb-de26-4f60-a519-b2d06fe45da3 of volume 65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] snapshot_file for this snap is: volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9960f2ea-64a9-439f-9313-3aee070c797b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:02 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 Jul 16 11:04:02 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:02 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3" returned: 0 in 0.427s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed00408d-74fb-45dd-89e1-b98d03e1b19d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:02 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:04:02 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:03 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.428s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:04:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:03 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 Jul 16 11:04:03 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:03 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3" returned: 0 in 0.408s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:03 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3 Jul 16 11:04:03 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:03 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.1e85b7cb-de26-4f60-a519-b2d06fe45da3" returned: 0 in 0.260s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-1e85b7cb-de26-4f60-a519-b2d06fe45da3" released by "_delete_snapshot" :: held 1.657s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" released by "delete_snapshot" :: held 1.695s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:03 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Created reservations ['fdf76be3-3589-4026-a606-ab6eacb48935', 'f2645689-1ab4-4aa1-95de-b9c495d2d610', 'f05ea705-60b5-48ec-835c-bc0163705989', '55742692-0982-4013-b4f9-a6075ecb3ee1'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:04:03 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Delete snapshot completed successfully. Jul 16 11:04:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-41aa0fc5-51fe-4f2a-a6dd-2b64686d9b43 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-1e85b7cb-de26-4f60-a519-b2d06fe45da3-delete_snapshot" released by "delete_snapshot" :: held 1.894s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:04 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] Creating offline snapshot dbbdd248-6476-4182-82c6-1d41f3b60816 of volume 65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:04:04 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c820774-0a25-4615-a4ac-f0164c85d20d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:04 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:04:04 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:05 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.422s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:04:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:05 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 1G Jul 16 11:04:05 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:05 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 1G" returned: 0 in 0.632s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:05 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 Jul 16 11:04:05 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:06 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816" returned: 0 in 0.348s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:06 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 is being set with open permissions: ugo+rw Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:06 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 Jul 16 11:04:06 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Flow 'volume_create_manager' (f90a36e2-a431-4b2d-9157-872a9c6e527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01670d64-8456-4a5e-a724-574382795a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01670d64-8456-4a5e-a724-574382795a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-530051632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17f780a-d3b7-451a-8310-1e3c8feeced5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b1f924d86f4ed59a742653be3e32c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:06Z,use_quota=True,user_id='31fe0052055d403baea4b948c9efa913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48b75230-49f3-4c46-b53d-2adbe2bb4226),volume_type_id=48b75230-49f3-4c46-b53d-2adbe2bb4226)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:06 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237d27c3-9f18-45db-b9b5-f18074edd0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (237d27c3-9f18-45db-b9b5-f18074edd0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec004eb-0983-4dc2-8989-5cfb3c1f0cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec004eb-0983-4dc2-8989-5cfb3c1f0cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd17f780a-d3b7-451a-8310-1e3c8feeced5', 'volume_name': 'volume-d17f780a-d3b7-451a-8310-1e3c8feeced5', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107a3761-c030-41c9-9291-bcf81da0a963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107a3761-c030-41c9-9291-bcf81da0a963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38dee171-dd23-4806-bc77-2e8008189621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:06 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Volume d17f780a-d3b7-451a-8310-1e3c8feeced5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d17f780a-d3b7-451a-8310-1e3c8feeced5', 'volume_size': 1} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816" returned: 0 in 0.316s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-530051632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17f780a-d3b7-451a-8310-1e3c8feeced5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b1f924d86f4ed59a742653be3e32c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:06Z,use_quota=True,user_id='31fe0052055d403baea4b948c9efa913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48b75230-49f3-4c46-b53d-2adbe2bb4226),volume_type_id=48b75230-49f3-4c46-b53d-2adbe2bb4226)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Creating volume d17f780a-d3b7-451a-8310-1e3c8feeced5 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:04:06 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:06 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5 1073741824 Jul 16 11:04:06 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:06 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a13c165d-4e4b-4e07-8960-66221774fdf0 tempest-SnapshotsActionsTest-667819603 None] Create snapshot completed successfully Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-dbbdd248-6476-4182-82c6-1d41f3b60816-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-dbbdd248-6476-4182-82c6-1d41f3b60816-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Acquiring lock "cinder-quobyte-dbbdd248-6476-4182-82c6-1d41f3b60816" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-dbbdd248-6476-4182-82c6-1d41f3b60816" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Deleting offline snapshot dbbdd248-6476-4182-82c6-1d41f3b60816 of volume 65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] snapshot_file for this snap is: volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[186c560b-62e1-453b-8337-819aef45bb04]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:07 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5 1073741824" returned: 0 in 0.563s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:07 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 Jul 16 11:04:07 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:07 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5 Jul 16 11:04:07 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:07 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5" returned: 0 in 0.267s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38dee171-dd23-4806-bc77-2e8008189621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17f780a-d3b7-451a-8310-1e3c8feeced5', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:07 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9253e18f-fd79-4f9c-80ba-7f4b1bcee52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816" returned: 0 in 0.428s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe6aa88-af66-4e37-aae9-198470a8ede9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Volume volume-d17f780a-d3b7-451a-8310-1e3c8feeced5 (d17f780a-d3b7-451a-8310-1e3c8feeced5): created successfully Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9253e18f-fd79-4f9c-80ba-7f4b1bcee52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Flow 'volume_create_manager' (f90a36e2-a431-4b2d-9157-872a9c6e527f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:07 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8d89df87-50d6-4766-8547-ec6ee4c7121a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Created volume successfully. Jul 16 11:04:07 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:04:07 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:07 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.402s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:04:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:07 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 Jul 16 11:04:07 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:08 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816" returned: 0 in 0.490s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:08 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816 Jul 16 11:04:08 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:08 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.dbbdd248-6476-4182-82c6-1d41f3b60816" returned: 0 in 0.306s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-dbbdd248-6476-4182-82c6-1d41f3b60816" released by "_delete_snapshot" :: held 1.757s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" released by "delete_snapshot" :: held 1.787s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Created reservations ['8080095e-9daa-43cb-b8cb-46771b50abb8', '9f0c1117-ea1e-43c5-ae61-e49d47db310b', '3cdc6f71-19f7-47f5-a095-00bfb0cdbc81', '41d59fe9-8a23-4bc8-9452-491e94e1e066'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:04:08 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Delete snapshot completed successfully. Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2dd7dd01-e159-4623-8cc3-95966338e158 tempest-SnapshotsActionsTest-508658507 None] Lock "cinder-dbbdd248-6476-4182-82c6-1d41f3b60816-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5d82d32d-3c03-47f4-831f-3ded358b367d tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5d82d32d-3c03-47f4-831f-3ded358b367d tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5d82d32d-3c03-47f4-831f-3ded358b367d tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5d82d32d-3c03-47f4-831f-3ded358b367d tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5d82d32d-3c03-47f4-831f-3ded358b367d tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d82d32d-3c03-47f4-831f-3ded358b367d tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:09 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:04:09 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:09 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d82d32d-3c03-47f4-831f-3ded358b367d tempest-VolumeRetypeWithoutMigrationTest-675643892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.375s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-5d82d32d-3c03-47f4-831f-3ded358b367d tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:04:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5d82d32d-3c03-47f4-831f-3ded358b367d tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Retype volume completed successfully. Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "cinder-4b29794e-7c79-4b39-a7e9-cd09363815ee-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Lock "cinder-4b29794e-7c79-4b39-a7e9-cd09363815ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "cinder-quobyte-4b29794e-7c79-4b39-a7e9-cd09363815ee" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Lock "cinder-quobyte-4b29794e-7c79-4b39-a7e9-cd09363815ee" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Deleting offline snapshot 4b29794e-7c79-4b39-a7e9-cd09363815ee of volume 65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] snapshot_file for this snap is: volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3798cf6-07d9-494b-b128-63f8950972b9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:09 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:04:09 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:10 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.483s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fbdb83-e6ba-4268-8825-716bde402f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded524d0-7c28-4480-befd-cf4e9cbebccf]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Acquiring lock "cinder-d17f780a-d3b7-451a-8310-1e3c8feeced5-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "cinder-d17f780a-d3b7-451a-8310-1e3c8feeced5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:10 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 Jul 16 11:04:10 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Acquiring lock "cinder-quobyte-d17f780a-d3b7-451a-8310-1e3c8feeced5" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "cinder-quobyte-d17f780a-d3b7-451a-8310-1e3c8feeced5" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bafbf64-d040-4766-ade5-c2c006db1b5e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:10 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5 Jul 16 11:04:10 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:10 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67" returned: 0 in 0.611s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:10 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:04:10 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:11 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5" returned: 0 in 0.516s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:11 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5 Jul 16 11:04:11 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:11 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.490s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:11 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee Jul 16 11:04:11 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:11 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d17f780a-d3b7-451a-8310-1e3c8feeced5" returned: 0 in 0.315s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "cinder-quobyte-d17f780a-d3b7-451a-8310-1e3c8feeced5" released by "delete_volume" :: held 0.890s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=103,cinder:SELECT=96,cinder:INSERT=23,cinder:DELETE=9 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:04:11 devstack cinder-volume[87345]: WARNING cinder.quota [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:04:11 devstack cinder-volume[87345]: WARNING cinder.quota [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Created reservations ['75cf03ea-a662-4617-a56e-237781954176', '97a6871f-8d14-4db6-9fa7-a6cec55ef1cd', '8e4570bd-7d20-41e4-ac78-a8c2cc9cb70d', '73cbb314-e28a-43f1-87e6-fe45ce2eb1c1'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:11 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:04:11 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:11 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67.4b29794e-7c79-4b39-a7e9-cd09363815ee" returned: 0 in 0.345s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Lock "cinder-quobyte-4b29794e-7c79-4b39-a7e9-cd09363815ee" released by "_delete_snapshot" :: held 2.094s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" released by "delete_snapshot" :: held 2.139s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Created reservations ['0333aa23-d791-42bb-b795-8d86c65ae597', '3377072c-d83f-49ee-84fd-311b32ba2728', 'a4d79018-5be4-4cd4-9194-5937491b02f4', 'c81b531d-e743-4237-b9e5-2f9f46949a8a'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:04:11 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Delete snapshot completed successfully. Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a5f4398-a0ee-409c-b3a9-4c74da5ac7c6 tempest-SnapshotsActionsTest-667819603 None] Lock "cinder-4b29794e-7c79-4b39-a7e9-cd09363815ee-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:11 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.329s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:04:11 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Deleted volume successfully. Jul 16 11:04:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f959794a-8a19-4a25-8502-d73b6bccfa6a tempest-VolumeRetypeWithoutMigrationTest-675643892 None] Lock "cinder-d17f780a-d3b7-451a-8310-1e3c8feeced5-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "cinder-65fbdb83-e6ba-4268-8825-716bde402f67-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Lock "cinder-65fbdb83-e6ba-4268-8825-716bde402f67-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:13 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdfc4de-19d8-41cb-b5fa-96e452aee780]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:13 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 Jul 16 11:04:13 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:13 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67" returned: 0 in 0.424s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:13 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67 Jul 16 11:04:13 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:13 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-65fbdb83-e6ba-4268-8825-716bde402f67" returned: 0 in 0.319s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Lock "cinder-quobyte-65fbdb83-e6ba-4268-8825-716bde402f67" released by "delete_volume" :: held 0.828s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:13 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Created reservations ['4278d45e-c672-411e-85f1-e90da174fef6', 'f0607bd7-03a3-48e1-b33a-3d462e97b061', '27bba5c8-3e72-43d2-ae59-ef60fb526520', 'dd99a5bf-02cf-412d-8d0e-06cee30abb8a'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:04:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:14 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:04:14 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:14 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.299s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:14 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:04:14 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Deleted volume successfully. Jul 16 11:04:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-82666ab4-453b-4816-8778-1f4fb3e8d62e tempest-SnapshotsActionsTest-667819603 None] Lock "cinder-65fbdb83-e6ba-4268-8825-716bde402f67-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c7db67c5-1983-487d-a771-fa83d5fbbe62 req-3d249e8c-6377-4fc3-abd5-e8e787d89871 tempest-ServerActionsTestOtherA-315179138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c7db67c5-1983-487d-a771-fa83d5fbbe62 req-3d249e8c-6377-4fc3-abd5-e8e787d89871 tempest-ServerActionsTestOtherA-315179138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c7db67c5-1983-487d-a771-fa83d5fbbe62 req-3d249e8c-6377-4fc3-abd5-e8e787d89871 tempest-ServerActionsTestOtherA-315179138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-c7db67c5-1983-487d-a771-fa83d5fbbe62 req-3d249e8c-6377-4fc3-abd5-e8e787d89871 tempest-ServerActionsTestOtherA-315179138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-40c56386-59af-48cb-aaf8-ef548c123bcc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63936e08-34ba-4153-a86d-f737780df0af', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:04:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-c7db67c5-1983-487d-a771-fa83d5fbbe62 req-3d249e8c-6377-4fc3-abd5-e8e787d89871 tempest-ServerActionsTestOtherA-315179138 None] attachment_update completed successfully. Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Flow 'volume_create_manager' (385d36b5-58f6-4949-ad35-9fbab90546a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129d0c4c-b981-48c1-b16c-12c2a5bbf158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129d0c4c-b981-48c1-b16c-12c2a5bbf158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1542401547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea66c80-673c-460a-a665-f4b429a6a55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb13423d9304f60afbf346639694d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:20Z,use_quota=True,user_id='0dc98825f3444c05bdb1dbdc74ae19d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fb097d-7894-45e2-8775-50de7a3603eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fb097d-7894-45e2-8775-50de7a3603eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d807f0-26b8-465d-85ad-3e6ce585f797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d807f0-26b8-465d-85ad-3e6ce585f797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea66c80-673c-460a-a665-f4b429a6a55e', 'volume_name': 'volume-7ea66c80-673c-460a-a665-f4b429a6a55e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d69fda5-7bd2-4059-bb7a-dea4c209fce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d69fda5-7bd2-4059-bb7a-dea4c209fce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac06f026-b30e-4cae-97c6-27571751a760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:19 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Volume 7ea66c80-673c-460a-a665-f4b429a6a55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea66c80-673c-460a-a665-f4b429a6a55e', 'volume_size': 1} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1542401547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea66c80-673c-460a-a665-f4b429a6a55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cb13423d9304f60afbf346639694d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:20Z,use_quota=True,user_id='0dc98825f3444c05bdb1dbdc74ae19d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Creating volume 7ea66c80-673c-460a-a665-f4b429a6a55e {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:04:19 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:04:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:19 devstack sudo[91894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e 1073741824 Jul 16 11:04:19 devstack sudo[91894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:20 devstack sudo[91894]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e 1073741824" returned: 0 in 0.614s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:20 devstack sudo[91908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e Jul 16 11:04:20 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-6db6c125-42f5-4f8c-a835-58b021fa45fd req-94d72ad3-48b0-49b7-b0e4-507a55f7272c tempest-ServerActionsTestOtherA-315179138 None] Terminate volume connection completed successfully. Jul 16 11:04:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-6db6c125-42f5-4f8c-a835-58b021fa45fd req-94d72ad3-48b0-49b7-b0e4-507a55f7272c tempest-ServerActionsTestOtherA-315179138 None] Deleting attachment 63936e08-34ba-4153-a86d-f737780df0af. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:04:20 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e" returned: 0 in 0.362s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:04:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac06f026-b30e-4cae-97c6-27571751a760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea66c80-673c-460a-a665-f4b429a6a55e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564d915e-3156-4b29-82e2-346122e159b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:20 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Volume volume-7ea66c80-673c-460a-a665-f4b429a6a55e (7ea66c80-673c-460a-a665-f4b429a6a55e): created successfully Jul 16 11:04:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564d915e-3156-4b29-82e2-346122e159b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Flow 'volume_create_manager' (385d36b5-58f6-4949-ad35-9fbab90546a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7b9417cb-5515-4ef8-8575-dcd30f4e8ab4 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Created volume successfully. Jul 16 11:04:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-6db6c125-42f5-4f8c-a835-58b021fa45fd req-3e98a478-8695-4614-8146-fad42477bf57 tempest-ServerActionsTestOtherA-315179138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-6db6c125-42f5-4f8c-a835-58b021fa45fd req-3e98a478-8695-4614-8146-fad42477bf57 tempest-ServerActionsTestOtherA-315179138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-6db6c125-42f5-4f8c-a835-58b021fa45fd req-3e98a478-8695-4614-8146-fad42477bf57 tempest-ServerActionsTestOtherA-315179138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-6db6c125-42f5-4f8c-a835-58b021fa45fd req-3e98a478-8695-4614-8146-fad42477bf57 tempest-ServerActionsTestOtherA-315179138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-40c56386-59af-48cb-aaf8-ef548c123bcc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdd157ce-eacb-4a47-bc8a-dfd054d6efda', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:04:21 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-6db6c125-42f5-4f8c-a835-58b021fa45fd req-3e98a478-8695-4614-8146-fad42477bf57 tempest-ServerActionsTestOtherA-315179138 None] attachment_update completed successfully. Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Flow 'volume_create_manager' (67b58d88-5301-4740-87b4-4468321706cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f726033b-1414-4462-bb50-3648c013eee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f726033b-1414-4462-bb50-3648c013eee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-616888889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadb670b-b7e6-48a5-9b5a-91ec4d395425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc41807a4b84204a170d78a9c6bdf15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:22Z,use_quota=True,user_id='7ce49b5f22334beebb653c5d8a7134e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3041281-bfb4-420b-9777-9cda811e0d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3041281-bfb4-420b-9777-9cda811e0d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5fd434-6217-461d-a7ab-a56cd151ac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5fd434-6217-461d-a7ab-a56cd151ac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dadb670b-b7e6-48a5-9b5a-91ec4d395425', 'volume_name': 'volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadd30a7-86a8-4e28-89e5-1c993572a8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadd30a7-86a8-4e28-89e5-1c993572a8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63552949-ac84-4253-ae8b-55326c7c490b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:22 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Volume dadb670b-b7e6-48a5-9b5a-91ec4d395425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425', 'volume_size': 1} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-616888889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadb670b-b7e6-48a5-9b5a-91ec4d395425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc41807a4b84204a170d78a9c6bdf15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:22Z,use_quota=True,user_id='7ce49b5f22334beebb653c5d8a7134e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Creating volume dadb670b-b7e6-48a5-9b5a-91ec4d395425 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:04:22 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:22 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425 1073741824 Jul 16 11:04:22 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:23 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425 1073741824" returned: 0 in 0.944s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:23 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425 Jul 16 11:04:23 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:24 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.184s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63552949-ac84-4253-ae8b-55326c7c490b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4c3d12-c5dc-4861-a943-66e2e695f8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Creating offline snapshot 2b713528-4e66-4f4c-9eb5-83770035995e of volume 7ea66c80-673c-460a-a665-f4b429a6a55e {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:04:24 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Volume volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425 (dadb670b-b7e6-48a5-9b5a-91ec4d395425): created successfully Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e4c3d12-c5dc-4861-a943-66e2e695f8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Flow 'volume_create_manager' (67b58d88-5301-4740-87b4-4468321706cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73d4745-c341-4081-bf32-ae5058524717]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:24 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8f8490d6-3aad-4450-9df8-b982c9585f66 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Created volume successfully. Jul 16 11:04:24 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e Jul 16 11:04:24 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:24 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e" returned: 0 in 0.521s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:24 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e 1G Jul 16 11:04:24 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:25 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e 1G" returned: 0 in 0.935s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea66c80-673c-460a-a665-f4b429a6a55e -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:25 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea66c80-673c-460a-a665-f4b429a6a55e -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e Jul 16 11:04:25 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:26 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea66c80-673c-460a-a665-f4b429a6a55e -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e" returned: 0 in 0.777s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:26 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e is being set with open permissions: ugo+rw Jul 16 11:04:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:26 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e Jul 16 11:04:26 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:26 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e" returned: 0 in 0.354s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Acquiring lock "cinder-dadb670b-b7e6-48a5-9b5a-91ec4d395425-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:26 devstack sudo[92504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.info Jul 16 11:04:26 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Lock "cinder-dadb670b-b7e6-48a5-9b5a-91ec4d395425-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Acquiring lock "cinder-quobyte-dadb670b-b7e6-48a5-9b5a-91ec4d395425" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Lock "cinder-quobyte-dadb670b-b7e6-48a5-9b5a-91ec4d395425" acquired by "delete_volume" :: waited 0.032s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:27 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4054b7a1-594c-474c-a3a2-1ef4760e5b1c]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:27 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425 Jul 16 11:04:27 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:27 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.info" returned: 0 in 0.707s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:27 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.info is being set with open permissions: ugo+rw Jul 16 11:04:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:27 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.info Jul 16 11:04:27 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:27 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425" returned: 0 in 0.690s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:27 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425 Jul 16 11:04:27 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:28 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.info" returned: 0 in 0.490s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.036s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e3f602fd-dd5a-4710-bbb6-be7266a55ce8 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Create snapshot completed successfully Jul 16 11:04:28 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dadb670b-b7e6-48a5-9b5a-91ec4d395425" returned: 0 in 0.679s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Lock "cinder-quobyte-dadb670b-b7e6-48a5-9b5a-91ec4d395425" released by "delete_volume" :: held 1.473s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:28 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Created reservations ['50636111-b622-4473-937f-ac9c84e073bc', '51db31b2-f3a9-44c4-8abc-31a8caacbd1c', 'c6d3a3c5-c8df-48eb-adc4-0d0c4b2638c3', 'a54a3a0e-8db8-4957-8886-40d209703f44'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:04:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:28 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:04:28 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Acquiring lock "cinder-2b713528-4e66-4f4c-9eb5-83770035995e-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "cinder-2b713528-4e66-4f4c-9eb5-83770035995e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Acquiring lock "cinder-quobyte-7ea66c80-673c-460a-a665-f4b429a6a55e" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "cinder-quobyte-7ea66c80-673c-460a-a665-f4b429a6a55e" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Acquiring lock "cinder-quobyte-2b713528-4e66-4f4c-9eb5-83770035995e" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "cinder-quobyte-2b713528-4e66-4f4c-9eb5-83770035995e" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Deleting offline snapshot 2b713528-4e66-4f4c-9eb5-83770035995e of volume 7ea66c80-673c-460a-a665-f4b429a6a55e {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] snapshot_file for this snap is: volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[707c7e78-7fed-4aa9-ae10-b6ac16169121]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:29 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.861s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:04:29 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Deleted volume successfully. Jul 16 11:04:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2b06198e-110e-4ac7-9be6-0bc2e8100f73 tempest-VolumeQuotasNegativeTestJSON-1650727378 None] Lock "cinder-dadb670b-b7e6-48a5-9b5a-91ec4d395425-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:29 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e Jul 16 11:04:29 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:30 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e" returned: 0 in 0.635s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea66c80-673c-460a-a665-f4b429a6a55e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:04:30 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[378462ec-0810-4dab-babf-31a399f5dcbe]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:30 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e Jul 16 11:04:30 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:30 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e" returned: 0 in 0.631s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:30 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e Jul 16 11:04:30 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:31 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e" returned: 0 in 0.609s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:31 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e Jul 16 11:04:31 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:31 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e.2b713528-4e66-4f4c-9eb5-83770035995e" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "cinder-quobyte-2b713528-4e66-4f4c-9eb5-83770035995e" released by "_delete_snapshot" :: held 2.350s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "cinder-quobyte-7ea66c80-673c-460a-a665-f4b429a6a55e" released by "delete_snapshot" :: held 2.400s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:31 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Created reservations ['3ec27b0d-0b11-4b62-914d-239656713ab4', '427b5d99-ecf7-4790-aabf-6f79d6857499', '7fc8773a-10b6-495c-b7d0-78e7f1b0c4ee', '9ec64efe-91b5-49e5-80aa-735456e7885f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:04:31 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Delete snapshot completed successfully. Jul 16 11:04:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ce85f09-41b9-45e4-929c-2ea5e7e3ef73 tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "cinder-2b713528-4e66-4f4c-9eb5-83770035995e-delete_snapshot" released by "delete_snapshot" :: held 2.626s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Acquiring lock "cinder-7ea66c80-673c-460a-a665-f4b429a6a55e-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "cinder-7ea66c80-673c-460a-a665-f4b429a6a55e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Acquiring lock "cinder-quobyte-7ea66c80-673c-460a-a665-f4b429a6a55e" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "cinder-quobyte-7ea66c80-673c-460a-a665-f4b429a6a55e" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:33 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d83d2f-b01f-4f1f-86a1-84d8822c0af0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:33 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e Jul 16 11:04:33 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:33 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e" returned: 0 in 0.468s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:33 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e Jul 16 11:04:33 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:33 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ea66c80-673c-460a-a665-f4b429a6a55e" returned: 0 in 0.291s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "cinder-quobyte-7ea66c80-673c-460a-a665-f4b429a6a55e" released by "delete_volume" :: held 0.849s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:33 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Created reservations ['ed822da5-b936-43d4-aaa4-fb8803d00f8b', 'b8578315-c0b9-443a-8cc4-1cfe902b24d4', '99cad867-e55c-49af-98a2-a56e8025850a', '96424c0c-634f-4ff4-8727-09edae7cbb58'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:34 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:04:34 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:34 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.397s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:04:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Deleted volume successfully. Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-835662e0-8062-48c2-8629-97f0e408749b tempest-VolumeSnapshotQuotasNegativeTestJSON-500927592 None] Lock "cinder-7ea66c80-673c-460a-a665-f4b429a6a55e-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:34 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:04:34 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:35 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.422s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:04:35 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:04:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 8 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:04:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=107,cinder:UPDATE=110,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Flow 'volume_create_manager' (c3ad0337-308c-43d2-bc13-4544d728c307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee29d465-853f-4582-8deb-ff3fc0e011a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee29d465-853f-4582-8deb-ff3fc0e011a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1872123252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fb1a7a-a940-46ec-9990-435abeedc3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fab64a0204146f09b3ddb1683d3beef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:39Z,use_quota=True,user_id='c0c073c87bcb4f289bdde7c5ad442ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e83d67e-8fb8-413c-afcd-32eea01d878f),volume_type_id=5e83d67e-8fb8-413c-afcd-32eea01d878f)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b28f76-a3f0-4eba-8082-d79d47c95b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b28f76-a3f0-4eba-8082-d79d47c95b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef67c574-fb7c-410a-a268-d52b26123b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef67c574-fb7c-410a-a268-d52b26123b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85fb1a7a-a940-46ec-9990-435abeedc3f7', 'volume_name': 'volume-85fb1a7a-a940-46ec-9990-435abeedc3f7', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b42c96-3c00-4214-8894-31efff008c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b42c96-3c00-4214-8894-31efff008c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3306fa41-9f2d-4591-a8e4-db1d4d36635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Volume 85fb1a7a-a940-46ec-9990-435abeedc3f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85fb1a7a-a940-46ec-9990-435abeedc3f7', 'volume_size': 1} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1872123252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fb1a7a-a940-46ec-9990-435abeedc3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fab64a0204146f09b3ddb1683d3beef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:39Z,use_quota=True,user_id='c0c073c87bcb4f289bdde7c5ad442ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e83d67e-8fb8-413c-afcd-32eea01d878f),volume_type_id=5e83d67e-8fb8-413c-afcd-32eea01d878f)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Creating volume 85fb1a7a-a940-46ec-9990-435abeedc3f7 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:04:38 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:04:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:38 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7 1073741824 Jul 16 11:04:38 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:39 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7 1073741824" returned: 0 in 0.611s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:39 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7 Jul 16 11:04:39 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:39 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7" returned: 0 in 0.305s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:04:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3306fa41-9f2d-4591-a8e4-db1d4d36635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85fb1a7a-a940-46ec-9990-435abeedc3f7', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d33592-a219-4239-9b00-a6eb2c160f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:39 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Volume volume-85fb1a7a-a940-46ec-9990-435abeedc3f7 (85fb1a7a-a940-46ec-9990-435abeedc3f7): created successfully Jul 16 11:04:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d33592-a219-4239-9b00-a6eb2c160f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Flow 'volume_create_manager' (c3ad0337-308c-43d2-bc13-4544d728c307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:39 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c802704a-ca79-4059-a7f6-4a98e198eff5 tempest-VolumeTypesAccessTest-2046818103 None] Created volume successfully. Jul 16 11:04:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Acquiring lock "cinder-85fb1a7a-a940-46ec-9990-435abeedc3f7-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Lock "cinder-85fb1a7a-a940-46ec-9990-435abeedc3f7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Acquiring lock "cinder-quobyte-85fb1a7a-a940-46ec-9990-435abeedc3f7" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Lock "cinder-quobyte-85fb1a7a-a940-46ec-9990-435abeedc3f7" acquired by "delete_volume" :: waited 0.035s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:41 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f924838d-bfed-4556-934b-9731adf85261]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:41 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7 Jul 16 11:04:41 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:41 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7" returned: 0 in 0.379s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:41 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7 Jul 16 11:04:41 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:41 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-85fb1a7a-a940-46ec-9990-435abeedc3f7" returned: 0 in 0.322s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Lock "cinder-quobyte-85fb1a7a-a940-46ec-9990-435abeedc3f7" released by "delete_volume" :: held 0.765s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:41 devstack cinder-volume[87345]: WARNING cinder.quota [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-158143526 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-158143526, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:04:41 devstack cinder-volume[87345]: WARNING cinder.quota [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-158143526 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-158143526, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:04:41 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Created reservations ['1ce6b86e-efe3-492d-83a1-72be5887a45b', '9a554abd-b6fe-4252-9d89-6e8b0d6f9212', '3eb8cbad-9dd4-493e-b0b7-0bd976d4326d', 'c0d2422f-dffd-4f8f-af63-950319ae13f1'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:04:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:42 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:04:42 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:42 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.319s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:42 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:04:42 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Deleted volume successfully. Jul 16 11:04:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03f78c99-8dcc-45b6-9e66-dffdb80d55f6 tempest-VolumeTypesAccessTest-2046818103 None] Lock "cinder-85fb1a7a-a940-46ec-9990-435abeedc3f7-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Flow 'volume_create_manager' (a6681912-8a6e-49ef-b196-e4b1a6797a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de666fa8-3342-458e-b112-2cb6b05aec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de666fa8-3342-458e-b112-2cb6b05aec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-70520250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b376054d24047afb91f588781cb0126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:47Z,use_quota=True,user_id='155a2b181a4f43df9d7cd4ac4e29d4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf85098-299f-4539-8215-6ce59535265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf85098-299f-4539-8215-6ce59535265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be819612-c088-4d66-8681-79fd78a1d66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be819612-c088-4d66-8681-79fd78a1d66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d', 'volume_name': 'volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52dc60ae-fb1d-4823-a9b6-5913322e8a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52dc60ae-fb1d-4823-a9b6-5913322e8a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288df427-2081-4fc1-a77d-bce27c5dd135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:46 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Volume c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d', 'volume_size': 1} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-70520250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b376054d24047afb91f588781cb0126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:47Z,use_quota=True,user_id='155a2b181a4f43df9d7cd4ac4e29d4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Creating volume c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:04:46 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:04:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:46 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d 1073741824 Jul 16 11:04:46 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:47 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d 1073741824" returned: 0 in 0.482s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:47 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d Jul 16 11:04:47 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:47 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d" returned: 0 in 0.257s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:04:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288df427-2081-4fc1-a77d-bce27c5dd135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b045def4-f42f-41d4-a53c-b52f366e46d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:47 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Volume volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d (c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d): created successfully Jul 16 11:04:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b045def4-f42f-41d4-a53c-b52f366e46d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Flow 'volume_create_manager' (a6681912-8a6e-49ef-b196-e4b1a6797a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:47 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b76edf67-5047-4814-8171-b53d5d5ebbd9 tempest-AbsoluteLimitsTests-1824326352 None] Created volume successfully. Jul 16 11:04:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Acquiring lock "cinder-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Lock "cinder-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Acquiring lock "cinder-quobyte-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Lock "cinder-quobyte-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde3be01-4085-47da-8a2d-72bbe1d054bb]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:49 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d Jul 16 11:04:49 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:49 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d" returned: 0 in 0.414s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:49 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d Jul 16 11:04:49 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:49 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d" returned: 0 in 0.300s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Lock "cinder-quobyte-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d" released by "delete_volume" :: held 0.771s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Created reservations ['82cb65aa-e7e8-4689-946e-d509d91cc4b8', '56a9b1e2-25f8-4eab-80ac-b5fe5c52d7b4', '932887e2-ad3c-4685-a62e-a57f6a0c2bcf', 'a6ec137b-8c0e-4da2-82e6-483337e066ac'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:49 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:04:49 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:50 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Flow 'volume_create_manager' (88a9a638-620d-44e0-a7b1-f3e4ae89bc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e005dc8-a931-40a7-bf33-91413d6e0d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.543s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:04:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Deleted volume successfully. Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e005dc8-a931-40a7-bf33-91413d6e0d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-11410574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d33c32-12ac-4a72-bb26-16e5679dc6c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1b1decda14aae9b843c91a99d9d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:50Z,use_quota=True,user_id='d0a8fa2efc964158851dba98ca513472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a441b270-0c67-406a-9c79-8cf367547603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a441b270-0c67-406a-9c79-8cf367547603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0d5edd-9d90-413a-99a0-2ea21182c55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0d5edd-9d90-413a-99a0-2ea21182c55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d33c32-12ac-4a72-bb26-16e5679dc6c2', 'volume_name': 'volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efd18cc-cd02-40c7-9d61-6788e5fadeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efd18cc-cd02-40c7-9d61-6788e5fadeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b0edd8-94b4-4306-accf-e5132cd66e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:50 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Volume d0d33c32-12ac-4a72-bb26-16e5679dc6c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2', 'volume_size': 1} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-11410574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d33c32-12ac-4a72-bb26-16e5679dc6c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1b1decda14aae9b843c91a99d9d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:50Z,use_quota=True,user_id='d0a8fa2efc964158851dba98ca513472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Creating volume d0d33c32-12ac-4a72-bb26-16e5679dc6c2 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:04:50 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:50 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2 1073741824 Jul 16 11:04:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-63c4861c-552f-45d1-a1ae-0a66fe5bddaf tempest-AbsoluteLimitsTests-1824326352 None] Lock "cinder-c06caa82-7ee4-49d0-b5f2-d1a83acc9a5d-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:50 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:51 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2 1073741824" returned: 0 in 0.554s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:51 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2 Jul 16 11:04:51 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:51 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2" returned: 0 in 0.365s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:04:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b0edd8-94b4-4306-accf-e5132cd66e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59d821e-2be4-4c11-bb05-8ef3067bce59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:51 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Volume volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2 (d0d33c32-12ac-4a72-bb26-16e5679dc6c2): created successfully Jul 16 11:04:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59d821e-2be4-4c11-bb05-8ef3067bce59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Flow 'volume_create_manager' (88a9a638-620d-44e0-a7b1-f3e4ae89bc5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:51 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f015cd11-daa8-4081-822b-0c5b1e2b08c3 tempest-AttachVolumeNegativeTest-980360146 None] Created volume successfully. Jul 16 11:04:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-1f10bbd5-cf02-4f50-8f50-06a974926b3d req-1f60e319-7bef-4c80-81ee-3c64d1e2ce53 tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-1f10bbd5-cf02-4f50-8f50-06a974926b3d req-1f60e319-7bef-4c80-81ee-3c64d1e2ce53 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-1f10bbd5-cf02-4f50-8f50-06a974926b3d req-1f60e319-7bef-4c80-81ee-3c64d1e2ce53 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-1f10bbd5-cf02-4f50-8f50-06a974926b3d req-1f60e319-7bef-4c80-81ee-3c64d1e2ce53 tempest-AttachVolumeNegativeTest-980360146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27d3d1ed-2cb7-4627-a37d-d2bd3ef26b19', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:04:53 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-f0946e53-ffae-4235-b95f-37b96c62854c req-ea40399a-5ad9-4a3b-ad34-707f8f70d81e tempest-ServerActionsTestOtherA-315179138 None] Terminate volume connection completed successfully. Jul 16 11:04:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-f0946e53-ffae-4235-b95f-37b96c62854c req-ea40399a-5ad9-4a3b-ad34-707f8f70d81e tempest-ServerActionsTestOtherA-315179138 None] Deleting attachment cdd157ce-eacb-4a47-bc8a-dfd054d6efda. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:04:53 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-1f10bbd5-cf02-4f50-8f50-06a974926b3d req-1f60e319-7bef-4c80-81ee-3c64d1e2ce53 tempest-AttachVolumeNegativeTest-980360146 None] attachment_update completed successfully. Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Flow 'volume_create_manager' (bdae2c98-91de-4ef7-8a89-72bc00ee882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52142038-d2e1-4011-a304-b4683b55e917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52142038-d2e1-4011-a304-b4683b55e917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-310110556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7b3473-064f-488c-b982-7e2505d00f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a82170920e4db8af61d9a8d8188b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:55Z,use_quota=True,user_id='74091fd4efbe4128a640d9f90227c8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aa0bae-a436-4e48-bfcf-c369dc935c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aa0bae-a436-4e48-bfcf-c369dc935c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7abc3b-a549-4b74-af7a-588800fa5180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7abc3b-a549-4b74-af7a-588800fa5180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7b3473-064f-488c-b982-7e2505d00f98', 'volume_name': 'volume-ff7b3473-064f-488c-b982-7e2505d00f98', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b02e34c-83e9-46a4-9596-64a833a53d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b02e34c-83e9-46a4-9596-64a833a53d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeac81cb-15bf-4f61-acd7-1873c7360702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:55 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Volume ff7b3473-064f-488c-b982-7e2505d00f98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7b3473-064f-488c-b982-7e2505d00f98', 'volume_size': 1} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-310110556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7b3473-064f-488c-b982-7e2505d00f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a82170920e4db8af61d9a8d8188b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:55Z,use_quota=True,user_id='74091fd4efbe4128a640d9f90227c8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Creating volume ff7b3473-064f-488c-b982-7e2505d00f98 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:04:55 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:55 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 1073741824 Jul 16 11:04:55 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Flow 'volume_create_manager' (748b81c5-3fa6-45a7-be87-d00fdbd71ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2205762b-c4e4-41f5-b3d8-71e43f4512cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2205762b-c4e4-41f5-b3d8-71e43f4512cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1036126507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf2e32c-5ec4-4116-877a-1be8f29468b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed72f262bdd04928b01d1410580a0178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:56Z,use_quota=True,user_id='d70cdeb49aea4609b73b21f6dfffae45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04619c8a-8799-4709-bcc1-1ad45fd3e484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04619c8a-8799-4709-bcc1-1ad45fd3e484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3a8171-be67-45cb-888c-8492b7e535bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3a8171-be67-45cb-888c-8492b7e535bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf2e32c-5ec4-4116-877a-1be8f29468b1', 'volume_name': 'volume-caf2e32c-5ec4-4116-877a-1be8f29468b1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d50ad29-cb72-4fb3-adc6-a0e8c005983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d50ad29-cb72-4fb3-adc6-a0e8c005983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fd5d81-e5e6-4ea9-8fd1-0a4eff274cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:55 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Volume caf2e32c-5ec4-4116-877a-1be8f29468b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf2e32c-5ec4-4116-877a-1be8f29468b1', 'volume_size': 1} Jul 16 11:04:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:56 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 1073741824" returned: 0 in 0.755s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:56 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 Jul 16 11:04:56 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:56 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98" returned: 0 in 0.279s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1036126507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf2e32c-5ec4-4116-877a-1be8f29468b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed72f262bdd04928b01d1410580a0178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:04:56Z,use_quota=True,user_id='d70cdeb49aea4609b73b21f6dfffae45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Creating volume caf2e32c-5ec4-4116-877a-1be8f29468b1 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:04:56 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:56 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1 1073741824 Jul 16 11:04:56 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeac81cb-15bf-4f61-acd7-1873c7360702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7b3473-064f-488c-b982-7e2505d00f98', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a9e4fd-038e-4c48-a183-daae57c0667d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:56 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Volume volume-ff7b3473-064f-488c-b982-7e2505d00f98 (ff7b3473-064f-488c-b982-7e2505d00f98): created successfully Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a9e4fd-038e-4c48-a183-daae57c0667d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Flow 'volume_create_manager' (bdae2c98-91de-4ef7-8a89-72bc00ee882b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:56 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8b20d770-6a2b-4cac-8c0d-ac61bcee13c3 tempest-SnapshotMetadataTestJSON-16877387 None] Created volume successfully. Jul 16 11:04:57 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1 1073741824" returned: 0 in 0.556s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:57 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1 Jul 16 11:04:57 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:57 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1" returned: 0 in 0.349s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.026s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] Creating offline snapshot b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 of volume ff7b3473-064f-488c-b982-7e2505d00f98 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fd5d81-e5e6-4ea9-8fd1-0a4eff274cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf2e32c-5ec4-4116-877a-1be8f29468b1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e58e47-2d07-4808-9c1b-7c9aec836d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c8b63d-083a-40c0-88ba-ddd2a1443620]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:57 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Volume volume-caf2e32c-5ec4-4116-877a-1be8f29468b1 (caf2e32c-5ec4-4116-877a-1be8f29468b1): created successfully Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e58e47-2d07-4808-9c1b-7c9aec836d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:04:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Flow 'volume_create_manager' (748b81c5-3fa6-45a7-be87-d00fdbd71ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:04:57 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-df52e750-fdf7-49a2-922e-ec5eed280d45 tempest-VolumesMetadataTest-324684681 None] Created volume successfully. Jul 16 11:04:57 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 Jul 16 11:04:57 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:58 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98" returned: 0 in 0.531s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:58 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 1G Jul 16 11:04:58 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:58 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 1G" returned: 0 in 0.504s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7b3473-064f-488c-b982-7e2505d00f98 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:58 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7b3473-064f-488c-b982-7e2505d00f98 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 Jul 16 11:04:58 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Acquiring lock "cinder-caf2e32c-5ec4-4116-877a-1be8f29468b1-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Lock "cinder-caf2e32c-5ec4-4116-877a-1be8f29468b1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Acquiring lock "cinder-quobyte-caf2e32c-5ec4-4116-877a-1be8f29468b1" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Lock "cinder-quobyte-caf2e32c-5ec4-4116-877a-1be8f29468b1" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf90131-f98f-4d0c-b297-43e165583cda]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:58 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7b3473-064f-488c-b982-7e2505d00f98 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504" returned: 0 in 0.324s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:58 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 is being set with open permissions: ugo+rw Jul 16 11:04:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:58 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 Jul 16 11:04:58 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:59 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1 Jul 16 11:04:59 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:59 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504" returned: 0 in 0.300s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:59 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.info Jul 16 11:04:59 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:59 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1" returned: 0 in 0.507s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:59 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1 Jul 16 11:04:59 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:59 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.info" returned: 0 in 0.346s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:59 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.info is being set with open permissions: ugo+rw Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:59 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.info Jul 16 11:04:59 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:04:59 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-caf2e32c-5ec4-4116-877a-1be8f29468b1" returned: 0 in 0.308s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Lock "cinder-quobyte-caf2e32c-5ec4-4116-877a-1be8f29468b1" released by "delete_volume" :: held 0.868s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Created reservations ['a667646d-3ed3-454e-9db9-2c5d35bcceea', '099034ff-b8b4-4c5b-a564-34307ee22e04', '7fdf3398-f2e5-4ed1-a187-8e16ce6484f0', '37a585d3-07db-4f0b-b4a2-81833e7f3fe1'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:04:59 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Jul 16 11:04:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.info" returned: 0 in 0.345s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.482s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:00 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:05:00 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:00 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8f48c7e6-56b9-483e-b654-0d4214c8a585 tempest-SnapshotMetadataTestJSON-16877387 None] Create snapshot completed successfully Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Acquiring lock "cinder-40c56386-59af-48cb-aaf8-ef548c123bcc-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Lock "cinder-40c56386-59af-48cb-aaf8-ef548c123bcc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Acquiring lock "cinder-quobyte-40c56386-59af-48cb-aaf8-ef548c123bcc" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Lock "cinder-quobyte-40c56386-59af-48cb-aaf8-ef548c123bcc" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68ab883-b903-44d9-862b-3f14d8bea7bd]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:00 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.442s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:05:00 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Deleted volume successfully. Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e7f06e98-2374-4c94-8cea-c829fc390a63 tempest-VolumesMetadataTest-324684681 None] Lock "cinder-caf2e32c-5ec4-4116-877a-1be8f29468b1-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:00 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc Jul 16 11:05:00 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:00 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc" returned: 0 in 0.450s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:00 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc Jul 16 11:05:00 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:01 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-40c56386-59af-48cb-aaf8-ef548c123bcc" returned: 0 in 0.386s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Lock "cinder-quobyte-40c56386-59af-48cb-aaf8-ef548c123bcc" released by "delete_volume" :: held 0.931s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Created reservations ['3823ab95-ffc2-43c6-8708-0126962ae70c', 'c8cf2298-0bdf-4eb1-a6e3-8caeb4d7012b', 'becb7944-dbea-4781-b8f7-05a3d6c9ee3e', '2d53d65f-32e1-4d41-987e-37a73a0d0c1b'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:01 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:05:01 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Acquiring lock "cinder-b651bb6d-eabc-4b4e-9ba4-9e82eee7d504-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "cinder-b651bb6d-eabc-4b4e-9ba4-9e82eee7d504-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Acquiring lock "cinder-quobyte-ff7b3473-064f-488c-b982-7e2505d00f98" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "cinder-quobyte-ff7b3473-064f-488c-b982-7e2505d00f98" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Acquiring lock "cinder-quobyte-b651bb6d-eabc-4b4e-9ba4-9e82eee7d504" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:01 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.429s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:05:01 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Deleted volume successfully. Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "cinder-quobyte-b651bb6d-eabc-4b4e-9ba4-9e82eee7d504" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Deleting offline snapshot b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 of volume ff7b3473-064f-488c-b982-7e2505d00f98 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:05:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] snapshot_file for this snap is: volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:05:02 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6774b185-40f6-439e-ad50-dd6015926b69]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cb5ab73b-4ceb-4f3a-93cc-0692b6d82d7d tempest-ServerActionsTestOtherA-315179138 None] Lock "cinder-40c56386-59af-48cb-aaf8-ef548c123bcc-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:02 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 Jul 16 11:05:02 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:02 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504" returned: 0 in 0.525s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7b3473-064f-488c-b982-7e2505d00f98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:05:02 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd5c048-00c0-44a2-9ba4-5bf70deba7b5]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:02 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 Jul 16 11:05:02 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:03 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98" returned: 0 in 0.572s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:03 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 Jul 16 11:05:03 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:03 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504" returned: 0 in 0.541s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:03 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504 Jul 16 11:05:03 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:04 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98.b651bb6d-eabc-4b4e-9ba4-9e82eee7d504" returned: 0 in 0.310s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "cinder-quobyte-b651bb6d-eabc-4b4e-9ba4-9e82eee7d504" released by "_delete_snapshot" :: held 2.151s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "cinder-quobyte-ff7b3473-064f-488c-b982-7e2505d00f98" released by "delete_snapshot" :: held 2.218s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Created reservations ['85e10719-fc2b-427b-8187-6f23c5866ec9', '35a341fc-ca49-4ece-9004-9e1b7195bdf6', 'e978f2be-256c-4ed3-abbf-12a53763cd61', 'a519c171-fdc2-4db3-aa55-e47930ea6794'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:05:04 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Delete snapshot completed successfully. Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c5f88640-da3b-416f-b9fa-5e0d16beee56 tempest-SnapshotMetadataTestJSON-16877387 None] Lock "cinder-b651bb6d-eabc-4b4e-9ba4-9e82eee7d504-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Flow 'volume_create_manager' (56de46d1-e851-4aa9-bf79-7a681493b9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0575ad8c-f138-4865-a3ec-31337207c9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0575ad8c-f138-4865-a3ec-31337207c9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1801169090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40c8180-0c6a-4d57-ac23-93b014b4fc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea6717f80e241508e73f2f979bed056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:04Z,use_quota=True,user_id='95e19a4e07cd43b1bc24950599e7547d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0ec18b-db09-4ef0-beda-edf11305e635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0ec18b-db09-4ef0-beda-edf11305e635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66945a2e-669d-49ac-a101-95f157c908c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66945a2e-669d-49ac-a101-95f157c908c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40c8180-0c6a-4d57-ac23-93b014b4fc9d', 'volume_name': 'volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116ca0d6-2602-4e6d-a34b-f4b8ff5a19cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116ca0d6-2602-4e6d-a34b-f4b8ff5a19cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ffee24-782e-424d-b31b-06f770017af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:04 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Volume b40c8180-0c6a-4d57-ac23-93b014b4fc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d', 'volume_size': 1} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1801169090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40c8180-0c6a-4d57-ac23-93b014b4fc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea6717f80e241508e73f2f979bed056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:04Z,use_quota=True,user_id='95e19a4e07cd43b1bc24950599e7547d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Creating volume b40c8180-0c6a-4d57-ac23-93b014b4fc9d {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:05:04 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:05:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:04 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d 1073741824 Jul 16 11:05:04 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Acquiring lock "cinder-ff7b3473-064f-488c-b982-7e2505d00f98-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Lock "cinder-ff7b3473-064f-488c-b982-7e2505d00f98-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:05 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d 1073741824" returned: 0 in 0.902s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Acquiring lock "cinder-quobyte-ff7b3473-064f-488c-b982-7e2505d00f98" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Lock "cinder-quobyte-ff7b3473-064f-488c-b982-7e2505d00f98" acquired by "delete_volume" :: waited 0.070s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:05 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d Jul 16 11:05:05 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:05 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95fdb5b-69dc-4058-8a81-73c9da4412d0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:05 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 Jul 16 11:05:05 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:06 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d" returned: 0 in 0.465s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ffee24-782e-424d-b31b-06f770017af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325940fb-4082-4a58-8437-864393eaddd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:06 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Volume volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d (b40c8180-0c6a-4d57-ac23-93b014b4fc9d): created successfully Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325940fb-4082-4a58-8437-864393eaddd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Flow 'volume_create_manager' (56de46d1-e851-4aa9-bf79-7a681493b9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:06 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c8b1c1a7-99a6-4da1-95b8-0b442c54549d tempest-VolumesCloneTest-1208336818 None] Created volume successfully. Jul 16 11:05:06 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98" returned: 0 in 0.614s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:06 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98 Jul 16 11:05:06 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:06 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff7b3473-064f-488c-b982-7e2505d00f98" returned: 0 in 0.394s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Lock "cinder-quobyte-ff7b3473-064f-488c-b982-7e2505d00f98" released by "delete_volume" :: held 1.123s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Created reservations ['883c81c7-e10f-4f4b-8615-c4d78fe49c50', 'b35a306e-007b-40e9-b171-4049bfd0b305', '1cac91e7-db0f-4b29-8846-fee55f47d21c', '7f3777bf-a3e4-498f-b82e-b0407c65d285'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:07 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:05:07 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:07 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.469s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:05:07 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Deleted volume successfully. Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1e8ee1a9-31b0-4309-8df7-2e5d8d6c591d tempest-SnapshotMetadataTestJSON-16877387 None] Lock "cinder-ff7b3473-064f-488c-b982-7e2505d00f98-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Flow 'volume_create_manager' (a2c7e9bc-ca23-47cb-beba-1bc9494fec9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f229a6-b8a9-4112-a084-d7922a43efc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f229a6-b8a9-4112-a084-d7922a43efc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-176197080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cc51e3-6814-4d9b-af23-935ec3f00c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea6717f80e241508e73f2f979bed056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b40c8180-0c6a-4d57-ac23-93b014b4fc9d,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:08Z,use_quota=True,user_id='95e19a4e07cd43b1bc24950599e7547d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a344de-68f8-47d7-9d0a-e35bbb691f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a344de-68f8-47d7-9d0a-e35bbb691f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d50dae-783b-436b-a254-d5e4e4b27344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d50dae-783b-436b-a254-d5e4e4b27344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '62cc51e3-6814-4d9b-af23-935ec3f00c38', 'volume_name': 'volume-62cc51e3-6814-4d9b-af23-935ec3f00c38', 'volume_size': 2, 'source_volid': 'b40c8180-0c6a-4d57-ac23-93b014b4fc9d', 'source_volstatus': 'available'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a482b1f8-8f1f-4bc0-b83b-5a26b7bc82b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a482b1f8-8f1f-4bc0-b83b-5a26b7bc82b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0570df-6a1f-4683-ac9d-ecf5a77938cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Volume 62cc51e3-6814-4d9b-af23-935ec3f00c38: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-62cc51e3-6814-4d9b-af23-935ec3f00c38', 'volume_size': 2, 'source_volid': 'b40c8180-0c6a-4d57-ac23-93b014b4fc9d', 'source_volstatus': 'available'} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:07 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Cloning volume b40c8180-0c6a-4d57-ac23-93b014b4fc9d to volume 62cc51e3-6814-4d9b-af23-935ec3f00c38 Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Creating offline snapshot a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 of volume b40c8180-0c6a-4d57-ac23-93b014b4fc9d {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64df61a-cc0a-4b01-8c5b-56e5f0ebb674]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:08 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d Jul 16 11:05:08 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:08 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d" returned: 0 in 0.603s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:08 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 1G Jul 16 11:05:08 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:09 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 1G" returned: 0 in 0.681s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:09 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 Jul 16 11:05:09 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:09 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168" returned: 0 in 0.446s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:09 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 is being set with open permissions: ugo+rw Jul 16 11:05:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:09 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 Jul 16 11:05:09 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:10 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168" returned: 0 in 0.509s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:10 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.info Jul 16 11:05:10 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:10 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.info" returned: 0 in 0.394s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:10 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.info is being set with open permissions: ugo+rw Jul 16 11:05:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:10 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.info Jul 16 11:05:10 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:11 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.info" returned: 0 in 0.392s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Acquiring lock "cinder-quobyte-62cc51e3-6814-4d9b-af23-935ec3f00c38" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Lock "cinder-quobyte-62cc51e3-6814-4d9b-af23-935ec3f00c38" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] snapshot: a4e43fb0-6275-4b50-8adc-4f0a5cd0e168, volume: 62cc51e3-6814-4d9b-af23-935ec3f00c38, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e22eba-81bb-40c5-952a-90c5f052f29a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:11 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 Jul 16 11:05:11 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:11 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168" returned: 0 in 0.619s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e89be52-184c-4cde-ab58-a8b01914900a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:12 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d Jul 16 11:05:12 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:12 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d" returned: 0 in 0.878s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:12 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:05:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:12 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 Jul 16 11:05:12 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:18 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:INSERT=33,cinder:UPDATE=114,cinder:SELECT=105,cinder:DELETE=11 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:05:18 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:05:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Flow 'volume_create_manager' (6e209961-4927-435a-bff3-c250567917fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1f2406-7a92-448d-a9b0-3d6975f9344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1f2406-7a92-448d-a9b0-3d6975f9344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1685738935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378d4428-857f-4c94-a48d-2a71eb5d7120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fbbf3cf02d4a4f825b88eb4c261371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:19Z,use_quota=True,user_id='5b4d629238364b96960ed8b0f4ccab8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82586222-6127-460c-bc85-14b70a41c6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82586222-6127-460c-bc85-14b70a41c6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92695446-1bb0-42b5-99f6-8ba594b87cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92695446-1bb0-42b5-99f6-8ba594b87cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378d4428-857f-4c94-a48d-2a71eb5d7120', 'volume_name': 'volume-378d4428-857f-4c94-a48d-2a71eb5d7120', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc8b745-f8e0-43a4-bc5e-5db74ecbc08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc8b745-f8e0-43a4-bc5e-5db74ecbc08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afbbfd2-3662-4dd1-bf52-407ac7d2b372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:19 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Volume 378d4428-857f-4c94-a48d-2a71eb5d7120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378d4428-857f-4c94-a48d-2a71eb5d7120', 'volume_size': 1} Jul 16 11:05:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:20 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38" returned: 0 in 7.553s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10174b4-69c3-4fd9-9d90-ad7d92d73e7e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:20 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d Jul 16 11:05:20 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:20 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d" returned: 0 in 0.530s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:20 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d, size 1024.00 MB, duration 7.55 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:05:20 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Converted 1024.00 MB image at 135.57 MB/s Jul 16 11:05:20 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 is being set with open permissions: ugo+rw Jul 16 11:05:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:20 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 Jul 16 11:05:20 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:21 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38" returned: 0 in 0.268s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Lock "cinder-quobyte-62cc51e3-6814-4d9b-af23-935ec3f00c38" released by "_copy_volume_from_snapshot" :: held 9.990s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Acquiring lock "cinder-quobyte-a4e43fb0-6275-4b50-8adc-4f0a5cd0e168" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Lock "cinder-quobyte-a4e43fb0-6275-4b50-8adc-4f0a5cd0e168" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Deleting offline snapshot a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 of volume b40c8180-0c6a-4d57-ac23-93b014b4fc9d {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] snapshot_file for this snap is: volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fed0d0c-6711-49c9-8b55-147bee3f22dc]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:21 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 Jul 16 11:05:21 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:21 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168" returned: 0 in 0.405s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54b8d2f-ad02-4a79-9c41-fea4af72c8b1]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:21 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d Jul 16 11:05:21 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:21 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d" returned: 0 in 0.393s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:22 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 Jul 16 11:05:22 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:22 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168" returned: 0 in 0.355s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:22 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168 Jul 16 11:05:22 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:22 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d.a4e43fb0-6275-4b50-8adc-4f0a5cd0e168" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Lock "cinder-quobyte-a4e43fb0-6275-4b50-8adc-4f0a5cd0e168" released by "_delete_snapshot" :: held 1.497s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.794s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.506s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1685738935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378d4428-857f-4c94-a48d-2a71eb5d7120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fbbf3cf02d4a4f825b88eb4c261371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:19Z,use_quota=True,user_id='5b4d629238364b96960ed8b0f4ccab8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Creating volume 378d4428-857f-4c94-a48d-2a71eb5d7120 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:05:22 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0570df-6a1f-4683-ac9d-ecf5a77938cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cc51e3-6814-4d9b-af23-935ec3f00c38', 'volume_size': 2, 'source_volid': 'b40c8180-0c6a-4d57-ac23-93b014b4fc9d', 'source_volstatus': 'available'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef1854e-fc49-4eab-9863-159a9b364b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:22 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120 1073741824 Jul 16 11:05:22 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:22 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Volume volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 (62cc51e3-6814-4d9b-af23-935ec3f00c38): created successfully Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef1854e-fc49-4eab-9863-159a9b364b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Flow 'volume_create_manager' (a2c7e9bc-ca23-47cb-beba-1bc9494fec9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:22 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-321f87a6-23a1-4357-a188-ed3d374febe6 tempest-VolumesCloneTest-1208336818 None] Created volume successfully. Jul 16 11:05:23 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120 1073741824" returned: 0 in 0.477s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:23 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120 Jul 16 11:05:23 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:23 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120" returned: 0 in 0.260s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afbbfd2-3662-4dd1-bf52-407ac7d2b372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378d4428-857f-4c94-a48d-2a71eb5d7120', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad2f16a-f05a-443e-9069-f39eaddaf126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:23 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Volume volume-378d4428-857f-4c94-a48d-2a71eb5d7120 (378d4428-857f-4c94-a48d-2a71eb5d7120): created successfully Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad2f16a-f05a-443e-9069-f39eaddaf126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Flow 'volume_create_manager' (6e209961-4927-435a-bff3-c250567917fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:23 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5a75bc06-818a-4102-bd13-9e627ffc8455 tempest-VolumesTransfersTest-1277785105 None] Created volume successfully. Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Acquiring lock "cinder-62cc51e3-6814-4d9b-af23-935ec3f00c38-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Lock "cinder-62cc51e3-6814-4d9b-af23-935ec3f00c38-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Acquiring lock "cinder-quobyte-62cc51e3-6814-4d9b-af23-935ec3f00c38" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Lock "cinder-quobyte-62cc51e3-6814-4d9b-af23-935ec3f00c38" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6b42c7-02fb-421e-b003-1681e9c329f8]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:23 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 Jul 16 11:05:23 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:24 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38" returned: 0 in 0.443s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:24 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38 Jul 16 11:05:24 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:24 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-62cc51e3-6814-4d9b-af23-935ec3f00c38" returned: 0 in 0.272s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Lock "cinder-quobyte-62cc51e3-6814-4d9b-af23-935ec3f00c38" released by "delete_volume" :: held 0.769s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Created reservations ['50723363-21d5-452a-9b1e-f6a9b23be9f0', '36a912dc-3096-47b1-b524-57ca9ff3ccb7', 'eaa4ffec-89c2-4fc9-9c52-1be832c54512', '7dcfb21d-9cf3-4552-a8f7-c63987de9084'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:24 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-eb3c43a1-a61e-4d69-8e2f-5600d8538ccc tempest-VolumesTransfersTest-180572513 None] Transfer volume completed successfully. Jul 16 11:05:24 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:05:24 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Acquiring lock "cinder-b40c8180-0c6a-4d57-ac23-93b014b4fc9d-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Lock "cinder-b40c8180-0c6a-4d57-ac23-93b014b4fc9d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:25 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.326s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:05:25 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Deleted volume successfully. Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4b1b9407-7d3c-4698-bb05-2f8dce842f6a tempest-VolumesCloneTest-1208336818 None] Lock "cinder-62cc51e3-6814-4d9b-af23-935ec3f00c38-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Acquiring lock "cinder-quobyte-b40c8180-0c6a-4d57-ac23-93b014b4fc9d" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Lock "cinder-quobyte-b40c8180-0c6a-4d57-ac23-93b014b4fc9d" acquired by "delete_volume" :: waited 0.032s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a77a1d-c621-4df4-baa7-10857c8e930c]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:25 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d Jul 16 11:05:25 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Acquiring lock "cinder-378d4428-857f-4c94-a48d-2a71eb5d7120-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Lock "cinder-378d4428-857f-4c94-a48d-2a71eb5d7120-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Acquiring lock "cinder-quobyte-378d4428-857f-4c94-a48d-2a71eb5d7120" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Lock "cinder-quobyte-378d4428-857f-4c94-a48d-2a71eb5d7120" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e722a-6ca0-455e-a3bb-6336f537e713]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:25 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d" returned: 0 in 0.589s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:25 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120 Jul 16 11:05:25 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:25 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d Jul 16 11:05:25 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:26 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120" returned: 0 in 0.489s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:26 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b40c8180-0c6a-4d57-ac23-93b014b4fc9d" returned: 0 in 0.314s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:26 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120 Jul 16 11:05:26 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Lock "cinder-quobyte-b40c8180-0c6a-4d57-ac23-93b014b4fc9d" released by "delete_volume" :: held 0.981s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Created reservations ['985cf584-ddaf-4c3c-beea-a6884936c4d5', 'dc69915b-8a16-44a5-9905-d4f5bc9d3680', '7fb4e391-aa7a-41f0-996a-08036ce1be9f', '0ba97fad-b7be-4cf0-9795-70b4f6754b01'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:26 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:05:26 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:26 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-378d4428-857f-4c94-a48d-2a71eb5d7120" returned: 0 in 0.332s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Lock "cinder-quobyte-378d4428-857f-4c94-a48d-2a71eb5d7120" released by "delete_volume" :: held 0.902s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Created reservations ['c2df9020-15e4-4147-9395-501637890d80', '66847d04-f2a8-4f48-b47a-d4408b707c37', '71464279-f587-4e50-b073-c88849d281c9', 'c2becf50-eeb8-4aa1-a877-bd9b224cc6b3'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:26 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.298s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:05:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Deleted volume successfully. Jul 16 11:05:26 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:05:26 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de79fa1-ce93-4e40-aa5b-9ecfb6f256e8 tempest-VolumesCloneTest-1208336818 None] Lock "cinder-b40c8180-0c6a-4d57-ac23-93b014b4fc9d-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:26 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.276s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:05:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Deleted volume successfully. Jul 16 11:05:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6148e2d9-c7b3-4d89-9169-96c73a38f6c5 tempest-VolumesTransfersTest-6117456 None] Lock "cinder-378d4428-857f-4c94-a48d-2a71eb5d7120-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Flow 'volume_create_manager' (6f78b4b1-11ca-4112-add2-15db19f0301d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16e5bb7-2e76-4081-9606-857422f8ea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16e5bb7-2e76-4081-9606-857422f8ea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1550583350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cef18be-f3b1-4acc-8ec8-091d548a060e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fbbf3cf02d4a4f825b88eb4c261371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:27Z,use_quota=True,user_id='5b4d629238364b96960ed8b0f4ccab8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe39e4b-1171-4be5-acec-b0976c67e548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe39e4b-1171-4be5-acec-b0976c67e548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6f512c-fded-48e7-923a-77caad0096cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6f512c-fded-48e7-923a-77caad0096cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cef18be-f3b1-4acc-8ec8-091d548a060e', 'volume_name': 'volume-4cef18be-f3b1-4acc-8ec8-091d548a060e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc4fd01-6c9b-4a53-b430-a146a0ce5ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc4fd01-6c9b-4a53-b430-a146a0ce5ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57012c9-0aa4-4ebf-bd5a-c789f9e069e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:27 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Volume 4cef18be-f3b1-4acc-8ec8-091d548a060e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cef18be-f3b1-4acc-8ec8-091d548a060e', 'volume_size': 1} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1550583350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cef18be-f3b1-4acc-8ec8-091d548a060e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2fbbf3cf02d4a4f825b88eb4c261371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:27Z,use_quota=True,user_id='5b4d629238364b96960ed8b0f4ccab8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Creating volume 4cef18be-f3b1-4acc-8ec8-091d548a060e {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:05:27 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:27 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e 1073741824 Jul 16 11:05:27 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:27 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e 1073741824" returned: 0 in 0.615s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:28 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e Jul 16 11:05:28 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:28 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e" returned: 0 in 0.437s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:05:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57012c9-0aa4-4ebf-bd5a-c789f9e069e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cef18be-f3b1-4acc-8ec8-091d548a060e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3deefdf5-8028-4a6b-872b-efa4135eee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:28 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Volume volume-4cef18be-f3b1-4acc-8ec8-091d548a060e (4cef18be-f3b1-4acc-8ec8-091d548a060e): created successfully Jul 16 11:05:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3deefdf5-8028-4a6b-872b-efa4135eee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Flow 'volume_create_manager' (6f78b4b1-11ca-4112-add2-15db19f0301d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a24e9da3-3c59-4fe5-8a3d-0718ad182d65 tempest-VolumesTransfersTest-1277785105 None] Created volume successfully. Jul 16 11:05:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Acquiring lock "cinder-4cef18be-f3b1-4acc-8ec8-091d548a060e-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Lock "cinder-4cef18be-f3b1-4acc-8ec8-091d548a060e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Acquiring lock "cinder-quobyte-4cef18be-f3b1-4acc-8ec8-091d548a060e" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Lock "cinder-quobyte-4cef18be-f3b1-4acc-8ec8-091d548a060e" acquired by "delete_volume" :: waited 0.032s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:29 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c26abd0-2906-4e86-bdc8-8c0fe0d4803f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:29 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e Jul 16 11:05:29 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:30 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e" returned: 0 in 0.389s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:30 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e Jul 16 11:05:30 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:30 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cef18be-f3b1-4acc-8ec8-091d548a060e" returned: 0 in 0.253s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Lock "cinder-quobyte-4cef18be-f3b1-4acc-8ec8-091d548a060e" released by "delete_volume" :: held 0.708s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Created reservations ['eda2c5a5-6713-4a9d-87fd-1301eaf607d6', '3fcdf2a5-fdb8-4181-b236-351ae6fffd6b', '16a9b028-1f20-4818-abb1-e1769f354e44', 'f2b4e640-c089-4eb5-b30b-6c002c8b8a74'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:30 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:05:30 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:30 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.289s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:05:30 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Deleted volume successfully. Jul 16 11:05:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04f0aa15-2981-445b-bd24-ed780736ff7f tempest-VolumesTransfersTest-6117456 None] Lock "cinder-4cef18be-f3b1-4acc-8ec8-091d548a060e-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Flow 'volume_create_manager' (0106c173-3d7c-4a14-a7bd-97b2e97b4a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7ae61e-9dda-4937-b8e6-e49d4e45c083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7ae61e-9dda-4937-b8e6-e49d4e45c083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1000953522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc609ea-2d4e-422e-8434-f96fead1d86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22754c54a6b848f4b05375a349beab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:31Z,use_quota=True,user_id='282a0819d952414f8dab0e75bc8f1d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636b13f3-5c0a-4a04-89f4-107d29a069a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636b13f3-5c0a-4a04-89f4-107d29a069a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1a9088-a51d-42e1-858b-923ecab6e562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1a9088-a51d-42e1-858b-923ecab6e562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc609ea-2d4e-422e-8434-f96fead1d86f', 'volume_name': 'volume-cbc609ea-2d4e-422e-8434-f96fead1d86f', 'volume_size': 2}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1133beb1-d1df-4e43-b9a4-94b192b0d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1133beb1-d1df-4e43-b9a4-94b192b0d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42979ee4-1b2d-41eb-8543-9c56ca3746b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:31 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Volume cbc609ea-2d4e-422e-8434-f96fead1d86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc609ea-2d4e-422e-8434-f96fead1d86f', 'volume_size': 2} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1000953522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc609ea-2d4e-422e-8434-f96fead1d86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22754c54a6b848f4b05375a349beab83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:31Z,use_quota=True,user_id='282a0819d952414f8dab0e75bc8f1d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Creating volume cbc609ea-2d4e-422e-8434-f96fead1d86f {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:05:31 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:05:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f 2147483648 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:31 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f 2147483648 Jul 16 11:05:31 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:32 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f 2147483648" returned: 0 in 0.848s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:32 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f Jul 16 11:05:32 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:32 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f" returned: 0 in 0.439s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:05:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42979ee4-1b2d-41eb-8543-9c56ca3746b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc609ea-2d4e-422e-8434-f96fead1d86f', 'volume_size': 2}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e91587-6103-48aa-9797-ef5c331c1965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:32 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Volume volume-cbc609ea-2d4e-422e-8434-f96fead1d86f (cbc609ea-2d4e-422e-8434-f96fead1d86f): created successfully Jul 16 11:05:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e91587-6103-48aa-9797-ef5c331c1965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Flow 'volume_create_manager' (0106c173-3d7c-4a14-a7bd-97b2e97b4a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:32 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7b5ab933-ea05-4e6e-ab80-4553b9c89605 tempest-VolumesCloneNegativeTest-2116311725 None] Created volume successfully. Jul 16 11:05:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Acquiring lock "cinder-cbc609ea-2d4e-422e-8434-f96fead1d86f-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Lock "cinder-cbc609ea-2d4e-422e-8434-f96fead1d86f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Acquiring lock "cinder-quobyte-cbc609ea-2d4e-422e-8434-f96fead1d86f" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Lock "cinder-quobyte-cbc609ea-2d4e-422e-8434-f96fead1d86f" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:33 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21c6707-aeeb-4367-a526-6c28023933cb]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:33 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f Jul 16 11:05:33 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:34 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f" returned: 0 in 0.420s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:34 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f Jul 16 11:05:34 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:34 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cbc609ea-2d4e-422e-8434-f96fead1d86f" returned: 0 in 0.410s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Lock "cinder-quobyte-cbc609ea-2d4e-422e-8434-f96fead1d86f" released by "delete_volume" :: held 0.886s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Created reservations ['5c8aa6a8-0b94-4f0f-8ae0-426633a02109', 'b3c82861-75f3-418b-a24b-2ba0b8fa557d', '071168d1-997c-4ab3-8b7c-ad234253249a', 'bd78efde-4716-4586-bbde-c23c4b9d8e8d'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:05:34 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:05:34 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:34 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:05:34 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:35 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.464s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:05:35 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:05:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 8 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:05:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:05:35 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.379s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:05:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Deleted volume successfully. Jul 16 11:05:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8ceec022-e41c-4278-84d4-b8feec9b51ad tempest-VolumesCloneNegativeTest-2116311725 None] Lock "cinder-cbc609ea-2d4e-422e-8434-f96fead1d86f-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-42f1aa8f-9543-42b1-b28b-de61638308f5 req-741532f9-6408-4b99-ad3d-d42e274b7f7e tempest-AttachVolumeNegativeTest-980360146 None] Terminate volume connection completed successfully. Jul 16 11:05:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-42f1aa8f-9543-42b1-b28b-de61638308f5 req-741532f9-6408-4b99-ad3d-d42e274b7f7e tempest-AttachVolumeNegativeTest-980360146 None] Deleting attachment 27d3d1ed-2cb7-4627-a37d-d2bd3ef26b19. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:05:39 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=82,cinder:UPDATE=128,cinder:INSERT=25,cinder:DELETE=9 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Flow 'volume_create_manager' (286e1187-a16b-49d4-a24b-4a0c98e1f46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8f39e5-2a21-4d0a-b8e0-24869b9bf83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8f39e5-2a21-4d0a-b8e0-24869b9bf83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1644241919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b447299c-9cf5-4df6-a7a2-9007ee7903cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c6a1943c9e4ceb92c3ef46222db6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:43Z,use_quota=True,user_id='0d76b3322ce8462587c3e8f53411fb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f3b361-33c1-4772-b32d-ac01ee3da4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f3b361-33c1-4772-b32d-ac01ee3da4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c74ae3e-9344-46b6-a6d2-20a58cde1958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c74ae3e-9344-46b6-a6d2-20a58cde1958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b447299c-9cf5-4df6-a7a2-9007ee7903cf', 'volume_name': 'volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d00176-f1c0-4f8b-824e-e86b47a6137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d00176-f1c0-4f8b-824e-e86b47a6137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063cb9b8-6ef4-4dbd-adf8-9092bc41f8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:43 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Volume b447299c-9cf5-4df6-a7a2-9007ee7903cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf', 'volume_size': 1} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1644241919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b447299c-9cf5-4df6-a7a2-9007ee7903cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c6a1943c9e4ceb92c3ef46222db6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:43Z,use_quota=True,user_id='0d76b3322ce8462587c3e8f53411fb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Creating volume b447299c-9cf5-4df6-a7a2-9007ee7903cf {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:05:43 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:05:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:43 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf 1073741824 Jul 16 11:05:43 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:44 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf 1073741824" returned: 0 in 0.599s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:44 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf Jul 16 11:05:44 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:44 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf" returned: 0 in 0.354s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:05:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063cb9b8-6ef4-4dbd-adf8-9092bc41f8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874f0868-1d6d-439e-a3ca-e1a062336646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:44 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Volume volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf (b447299c-9cf5-4df6-a7a2-9007ee7903cf): created successfully Jul 16 11:05:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874f0868-1d6d-439e-a3ca-e1a062336646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Flow 'volume_create_manager' (286e1187-a16b-49d4-a24b-4a0c98e1f46f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:44 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-34e0dfc0-8556-4b91-92c5-830ae7f31055 tempest-VolumesTransfersV357Test-1258352819 None] Created volume successfully. Jul 16 11:05:46 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-3f097710-16b4-4faf-a294-8f3fb9093d79 tempest-VolumesTransfersV357Test-1736511366 None] Transfer volume completed successfully. Jul 16 11:05:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Acquiring lock "cinder-b447299c-9cf5-4df6-a7a2-9007ee7903cf-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Lock "cinder-b447299c-9cf5-4df6-a7a2-9007ee7903cf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Acquiring lock "cinder-quobyte-b447299c-9cf5-4df6-a7a2-9007ee7903cf" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Lock "cinder-quobyte-b447299c-9cf5-4df6-a7a2-9007ee7903cf" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:48 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2fe0fc-e2ad-4f26-9a9f-24855812a0f6]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:48 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf Jul 16 11:05:48 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:48 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf" returned: 0 in 0.653s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:48 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf Jul 16 11:05:48 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:49 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b447299c-9cf5-4df6-a7a2-9007ee7903cf" returned: 0 in 0.397s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Lock "cinder-quobyte-b447299c-9cf5-4df6-a7a2-9007ee7903cf" released by "delete_volume" :: held 1.126s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Created reservations ['69b8ec06-c8e1-4e09-8432-d159ec6db134', '12be6400-a6e4-43b1-a3f0-7d3c68d11bce', '51d029ef-2b82-4ed1-838d-c9b455385658', '0091a3d7-10d3-42d1-bf0e-f4d47f3b0a40'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:49 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:05:49 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:49 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.298s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:05:49 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Deleted volume successfully. Jul 16 11:05:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-eeadb5de-e19f-48ae-b7b4-828606c55fd8 tempest-VolumesTransfersV357Test-2059258507 None] Lock "cinder-b447299c-9cf5-4df6-a7a2-9007ee7903cf-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Flow 'volume_create_manager' (b0d663a9-4302-4b7a-b90c-590920916c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec88573-91d6-4a78-b918-07e8f19b7213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec88573-91d6-4a78-b918-07e8f19b7213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1177884172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d129f4f9-d682-4c83-8478-27d76767b230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c6a1943c9e4ceb92c3ef46222db6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:51Z,use_quota=True,user_id='0d76b3322ce8462587c3e8f53411fb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec39c29-1869-4894-90a4-b907f65f50e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec39c29-1869-4894-90a4-b907f65f50e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0290420-fcca-4af6-a44c-fec51578bd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0290420-fcca-4af6-a44c-fec51578bd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd129f4f9-d682-4c83-8478-27d76767b230', 'volume_name': 'volume-d129f4f9-d682-4c83-8478-27d76767b230', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f18044-7dd2-46af-bfab-ca7d12546ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f18044-7dd2-46af-bfab-ca7d12546ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa3eba3-b30f-49a3-bf61-422ebfbaae92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:51 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Volume d129f4f9-d682-4c83-8478-27d76767b230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d129f4f9-d682-4c83-8478-27d76767b230', 'volume_size': 1} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1177884172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d129f4f9-d682-4c83-8478-27d76767b230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c6a1943c9e4ceb92c3ef46222db6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:05:51Z,use_quota=True,user_id='0d76b3322ce8462587c3e8f53411fb11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Creating volume d129f4f9-d682-4c83-8478-27d76767b230 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:05:51 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:51 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230 1073741824 Jul 16 11:05:51 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:51 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230 1073741824" returned: 0 in 0.707s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:52 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230 Jul 16 11:05:52 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:52 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230" returned: 0 in 0.377s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:05:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa3eba3-b30f-49a3-bf61-422ebfbaae92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d129f4f9-d682-4c83-8478-27d76767b230', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fddfd64-cb72-458c-8a91-1e2d2baf2a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:05:52 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Volume volume-d129f4f9-d682-4c83-8478-27d76767b230 (d129f4f9-d682-4c83-8478-27d76767b230): created successfully Jul 16 11:05:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fddfd64-cb72-458c-8a91-1e2d2baf2a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:05:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Flow 'volume_create_manager' (b0d663a9-4302-4b7a-b90c-590920916c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:05:52 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-39d23ab1-4865-48f3-8eb8-1d1572b783c0 tempest-VolumesTransfersV357Test-1258352819 None] Created volume successfully. Jul 16 11:05:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Acquiring lock "cinder-d129f4f9-d682-4c83-8478-27d76767b230-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Lock "cinder-d129f4f9-d682-4c83-8478-27d76767b230-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Acquiring lock "cinder-quobyte-d129f4f9-d682-4c83-8478-27d76767b230" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:05:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Lock "cinder-quobyte-d129f4f9-d682-4c83-8478-27d76767b230" acquired by "delete_volume" :: waited 0.034s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:05:53 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cfa9e0-c51b-4f30-b3da-e620035497b7]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:05:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:53 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230 Jul 16 11:05:53 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:54 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230" returned: 0 in 0.651s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:54 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230 Jul 16 11:05:54 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:54 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d129f4f9-d682-4c83-8478-27d76767b230" returned: 0 in 0.538s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Lock "cinder-quobyte-d129f4f9-d682-4c83-8478-27d76767b230" released by "delete_volume" :: held 1.278s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:05:55 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Created reservations ['dfd46187-8b07-4ba4-9eef-22ff2a1aacdd', '22b0b862-65ed-47d0-b62d-6d93f44a7f56', '36d35c31-89e5-4652-81b8-c445af2949c4', '9165eb1b-c88c-4c9c-8246-40d928e31836'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:05:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:05:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:05:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:05:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:05:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:05:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:05:55 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:05:55 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:05:55 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Jul 16 11:05:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.362s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:05:55 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:05:55 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Deleted volume successfully. Jul 16 11:05:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-87ebf9b6-8212-48da-bcf0-87a7f6d83499 tempest-VolumesTransfersV357Test-2059258507 None] Lock "cinder-d129f4f9-d682-4c83-8478-27d76767b230-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=74,cinder:SELECT=57,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Flow 'volume_create_manager' (f318a0f3-1a8a-4e20-9c9e-42b049154273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8266ef-d89e-4361-99cf-f947f5cea7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8266ef-d89e-4361-99cf-f947f5cea7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-977852535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694bbf72-ff6c-4a4c-840d-523fb942967e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e80738b69f426789c2211ad5ac5d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:05Z,use_quota=True,user_id='497aafebb27a4c38a199f0c7d3cc6c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116691f6-6ac3-4825-9745-0113699f47d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116691f6-6ac3-4825-9745-0113699f47d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6cb802-0abe-4d65-9bc0-6b6bce830a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6cb802-0abe-4d65-9bc0-6b6bce830a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694bbf72-ff6c-4a4c-840d-523fb942967e', 'volume_name': 'volume-694bbf72-ff6c-4a4c-840d-523fb942967e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd91dde3-cdea-4342-a34d-bb1f30501255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd91dde3-cdea-4342-a34d-bb1f30501255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f27c2a-c38a-4f47-907a-67671663a77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:05 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Volume 694bbf72-ff6c-4a4c-840d-523fb942967e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694bbf72-ff6c-4a4c-840d-523fb942967e', 'volume_size': 1} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-977852535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694bbf72-ff6c-4a4c-840d-523fb942967e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e80738b69f426789c2211ad5ac5d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:05Z,use_quota=True,user_id='497aafebb27a4c38a199f0c7d3cc6c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Creating volume 694bbf72-ff6c-4a4c-840d-523fb942967e {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:06:05 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:06:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:05 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e 1073741824 Jul 16 11:06:05 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:06 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e 1073741824" returned: 0 in 0.985s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:06 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e Jul 16 11:06:06 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:06 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e" returned: 0 in 0.474s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:06:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f27c2a-c38a-4f47-907a-67671663a77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694bbf72-ff6c-4a4c-840d-523fb942967e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfb986d-80f2-46d1-a3c8-113ac53466a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Volume volume-694bbf72-ff6c-4a4c-840d-523fb942967e (694bbf72-ff6c-4a4c-840d-523fb942967e): created successfully Jul 16 11:06:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfb986d-80f2-46d1-a3c8-113ac53466a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Flow 'volume_create_manager' (f318a0f3-1a8a-4e20-9c9e-42b049154273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:07 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f6e941d5-c83a-45cf-976f-272be52c572c tempest-VolumesListTestJSON-1412297462 None] Created volume successfully. Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Flow 'volume_create_manager' (0e8938e0-57c9-4611-a0f1-b20fbafed684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e6bb45-dd27-4d41-8714-4fd7a6d3087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e6bb45-dd27-4d41-8714-4fd7a6d3087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-317670368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1479b79-f1d5-4473-befb-df1d0e9044b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e80738b69f426789c2211ad5ac5d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:08Z,use_quota=True,user_id='497aafebb27a4c38a199f0c7d3cc6c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e311b22c-403b-4ec6-8309-a03da7cf987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e311b22c-403b-4ec6-8309-a03da7cf987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5399d9a3-1d14-4247-8b52-e52a4a41ff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5399d9a3-1d14-4247-8b52-e52a4a41ff2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1479b79-f1d5-4473-befb-df1d0e9044b1', 'volume_name': 'volume-c1479b79-f1d5-4473-befb-df1d0e9044b1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc346aa-bac8-4b1d-8828-d951c8b3f9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc346aa-bac8-4b1d-8828-d951c8b3f9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba93fba4-206b-404a-ba2f-4cbd74d4ba1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Volume c1479b79-f1d5-4473-befb-df1d0e9044b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1479b79-f1d5-4473-befb-df1d0e9044b1', 'volume_size': 1} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-317670368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1479b79-f1d5-4473-befb-df1d0e9044b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e80738b69f426789c2211ad5ac5d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:08Z,use_quota=True,user_id='497aafebb27a4c38a199f0c7d3cc6c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Creating volume c1479b79-f1d5-4473-befb-df1d0e9044b1 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:06:08 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:06:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:08 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1 1073741824 Jul 16 11:06:08 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:09 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1 1073741824" returned: 0 in 0.697s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:09 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1 Jul 16 11:06:09 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:09 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1" returned: 0 in 0.293s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:06:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba93fba4-206b-404a-ba2f-4cbd74d4ba1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1479b79-f1d5-4473-befb-df1d0e9044b1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19f4ed0-2223-411d-95be-a0ff9e3dbe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Volume volume-c1479b79-f1d5-4473-befb-df1d0e9044b1 (c1479b79-f1d5-4473-befb-df1d0e9044b1): created successfully Jul 16 11:06:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19f4ed0-2223-411d-95be-a0ff9e3dbe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Flow 'volume_create_manager' (0e8938e0-57c9-4611-a0f1-b20fbafed684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-988ff791-840e-4f0d-b15c-81f2a55a2891 tempest-VolumesListTestJSON-1412297462 None] Created volume successfully. Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Flow 'volume_create_manager' (68838ca8-ac28-49e4-b0f0-76de2efca229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3e5db2-3ee7-44c5-bd1b-010aeb41e280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3e5db2-3ee7-44c5-bd1b-010aeb41e280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1932122438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f09d5d-b74f-4ee7-87fd-6bfde6a44e88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e80738b69f426789c2211ad5ac5d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:11Z,use_quota=True,user_id='497aafebb27a4c38a199f0c7d3cc6c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3594557c-5b13-42a0-bcf6-b5d01e39690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3594557c-5b13-42a0-bcf6-b5d01e39690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c9c207-8850-463b-bb96-ab1626a4f111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c9c207-8850-463b-bb96-ab1626a4f111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f09d5d-b74f-4ee7-87fd-6bfde6a44e88', 'volume_name': 'volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84484f6e-91da-4c86-8fdf-f382a06a4da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84484f6e-91da-4c86-8fdf-f382a06a4da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b179b1-2a41-4c9e-8dee-41d0182fb59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:11 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Volume 53f09d5d-b74f-4ee7-87fd-6bfde6a44e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88', 'volume_size': 1} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1932122438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f09d5d-b74f-4ee7-87fd-6bfde6a44e88,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='38e80738b69f426789c2211ad5ac5d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:11Z,use_quota=True,user_id='497aafebb27a4c38a199f0c7d3cc6c81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Creating volume 53f09d5d-b74f-4ee7-87fd-6bfde6a44e88 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:06:11 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:06:11 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88 1073741824 Jul 16 11:06:11 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Flow 'volume_create_manager' (4c44aeb6-5af9-4a7e-a614-e87ee4bb20da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0c30ab-8d8b-474d-9d6c-b1aae6b1ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b0c30ab-8d8b-474d-9d6c-b1aae6b1ce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1885789845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34aa9714-96f7-483c-a9de-008c77f09c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f071c3d67a8646ca92a9becba4c38702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:12Z,use_quota=True,user_id='f362fbe5a02c44e9a87c8c99dacc5053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6ce54c-bcc1-4bfc-8670-90d03d8d3a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6ce54c-bcc1-4bfc-8670-90d03d8d3a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f221a5dd-378e-4086-af6c-a10680f489b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f221a5dd-378e-4086-af6c-a10680f489b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34aa9714-96f7-483c-a9de-008c77f09c51', 'volume_name': 'volume-34aa9714-96f7-483c-a9de-008c77f09c51', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0df572d-eb89-42af-b203-9643ca5a7845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0df572d-eb89-42af-b203-9643ca5a7845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b907a7f4-8cf7-490a-9aba-bed3c767301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:11 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Volume 34aa9714-96f7-483c-a9de-008c77f09c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34aa9714-96f7-483c-a9de-008c77f09c51', 'volume_size': 1} Jul 16 11:06:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:12 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88 1073741824" returned: 0 in 0.565s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:12 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88 Jul 16 11:06:12 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:12 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88" returned: 0 in 0.289s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.800s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1885789845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34aa9714-96f7-483c-a9de-008c77f09c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f071c3d67a8646ca92a9becba4c38702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:12Z,use_quota=True,user_id='f362fbe5a02c44e9a87c8c99dacc5053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Creating volume 34aa9714-96f7-483c-a9de-008c77f09c51 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:06:12 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:12 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51 1073741824 Jul 16 11:06:12 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b179b1-2a41-4c9e-8dee-41d0182fb59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093b250a-d1d8-4f7e-bde0-8a0523d5abf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:12 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Volume volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88 (53f09d5d-b74f-4ee7-87fd-6bfde6a44e88): created successfully Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093b250a-d1d8-4f7e-bde0-8a0523d5abf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Flow 'volume_create_manager' (68838ca8-ac28-49e4-b0f0-76de2efca229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:12 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9f34226f-2e7a-4418-9f4f-6721c51ddd74 tempest-VolumesListTestJSON-1412297462 None] Created volume successfully. Jul 16 11:06:13 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51 1073741824" returned: 0 in 0.597s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:13 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51 Jul 16 11:06:13 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:13 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51" returned: 0 in 0.380s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:06:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b907a7f4-8cf7-490a-9aba-bed3c767301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34aa9714-96f7-483c-a9de-008c77f09c51', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f94ce53-b9dc-4690-a596-86d0e756be19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:13 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Volume volume-34aa9714-96f7-483c-a9de-008c77f09c51 (34aa9714-96f7-483c-a9de-008c77f09c51): created successfully Jul 16 11:06:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f94ce53-b9dc-4690-a596-86d0e756be19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Flow 'volume_create_manager' (4c44aeb6-5af9-4a7e-a614-e87ee4bb20da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:13 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-15bce9c8-2da2-4b40-993f-0cfa1d38e505 tempest-AttachVolumeTestJSON-792425831 None] Created volume successfully. Jul 16 11:06:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-2b73e9a9-6775-457c-b8fc-566f10c07885 req-f78a99b5-a2de-475c-9acd-42f54c8fe1a9 tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-2b73e9a9-6775-457c-b8fc-566f10c07885 req-f78a99b5-a2de-475c-9acd-42f54c8fe1a9 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-2b73e9a9-6775-457c-b8fc-566f10c07885 req-f78a99b5-a2de-475c-9acd-42f54c8fe1a9 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-2b73e9a9-6775-457c-b8fc-566f10c07885 req-f78a99b5-a2de-475c-9acd-42f54c8fe1a9 tempest-AttachVolumeTestJSON-792425831 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-34aa9714-96f7-483c-a9de-008c77f09c51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f15ef94-0b87-435b-ae84-48b37c9c0657', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:06:16 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-2b73e9a9-6775-457c-b8fc-566f10c07885 req-f78a99b5-a2de-475c-9acd-42f54c8fe1a9 tempest-AttachVolumeTestJSON-792425831 None] attachment_update completed successfully. Jul 16 11:06:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "cinder-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:06:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:06:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "cinder-quobyte-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:06:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-quobyte-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88" acquired by "delete_volume" :: waited 0.033s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:06:16 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b8cb07-c5ca-488b-a661-6d9a4f154213]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:06:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:16 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88 Jul 16 11:06:16 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:16 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88" returned: 0 in 0.491s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:17 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88 Jul 16 11:06:17 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:17 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88" returned: 0 in 0.385s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-quobyte-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88" released by "delete_volume" :: held 0.941s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Created reservations ['9d720777-39ae-4278-8d23-d087a78a8abd', '76869e89-7a6a-4f34-8a2d-4da2a1077c37', '911ea76a-6968-4001-9752-5997bd321833', '19962461-31f5-4ac6-b311-05b494b4e305'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:17 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:06:17 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:17 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.294s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:06:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Deleted volume successfully. Jul 16 11:06:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c80fee8c-8d61-470d-a2f2-a14512654b3e tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-53f09d5d-b74f-4ee7-87fd-6bfde6a44e88-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Flow 'volume_create_manager' (2c4831fb-bd7a-45f0-9d81-9411ce9f993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d069bf4-9ddf-4eee-bc3a-5935d571795d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d069bf4-9ddf-4eee-bc3a-5935d571795d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1393631300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c08f33-c6b5-46dc-b728-edc6d0aed256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c3846a43194431b6d0ad3a6389f76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:19Z,use_quota=True,user_id='c4f4d0f4f26844588d5cfedebb0dcb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d339052-5d8e-48bf-94ae-ec70d55a4c75),volume_type_id=8d339052-5d8e-48bf-94ae-ec70d55a4c75)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed55252-72e4-4b20-b2b7-83a85e52ec0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed55252-72e4-4b20-b2b7-83a85e52ec0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60585244-dc04-4a76-b9a2-0f9a9497f68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60585244-dc04-4a76-b9a2-0f9a9497f68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c08f33-c6b5-46dc-b728-edc6d0aed256', 'volume_name': 'volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1bcfd6-a7d2-4377-b99a-5e832c0873ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1bcfd6-a7d2-4377-b99a-5e832c0873ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60cec60-9a50-4947-ae5f-796bc3a52ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:18 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Volume d0c08f33-c6b5-46dc-b728-edc6d0aed256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256', 'volume_size': 1} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1393631300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c08f33-c6b5-46dc-b728-edc6d0aed256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c3846a43194431b6d0ad3a6389f76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:19Z,use_quota=True,user_id='c4f4d0f4f26844588d5cfedebb0dcb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d339052-5d8e-48bf-94ae-ec70d55a4c75),volume_type_id=8d339052-5d8e-48bf-94ae-ec70d55a4c75)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Creating volume d0c08f33-c6b5-46dc-b728-edc6d0aed256 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:06:18 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "cinder-c1479b79-f1d5-4473-befb-df1d0e9044b1-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-c1479b79-f1d5-4473-befb-df1d0e9044b1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:06:18 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256 1073741824 Jul 16 11:06:18 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "cinder-quobyte-c1479b79-f1d5-4473-befb-df1d0e9044b1" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-quobyte-c1479b79-f1d5-4473-befb-df1d0e9044b1" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2257cb-656b-45a3-876a-96ecf070e1f7]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:06:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:18 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1 Jul 16 11:06:18 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Flow 'volume_create_manager' (2adf2698-e0fe-48f7-a59d-9fd9169f0222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debbb14e-7e93-4308-928c-03cb753988b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debbb14e-7e93-4308-928c-03cb753988b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-153561830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ef18d0-b7f3-4889-91f9-b302e53f8dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c3846a43194431b6d0ad3a6389f76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:19Z,use_quota=True,user_id='c4f4d0f4f26844588d5cfedebb0dcb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(768bfd26-0458-47c3-ac3b-d52c619737d3),volume_type_id=768bfd26-0458-47c3-ac3b-d52c619737d3)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7e8cbb-f4f0-41bb-9d99-b9b8e2ea611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7e8cbb-f4f0-41bb-9d99-b9b8e2ea611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b3ec69-97b3-44e7-88a8-4c46c1cdd7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b3ec69-97b3-44e7-88a8-4c46c1cdd7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ef18d0-b7f3-4889-91f9-b302e53f8dd9', 'volume_name': 'volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee485068-16d7-4339-bd28-863361e3ec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee485068-16d7-4339-bd28-863361e3ec67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12bb21c-5839-4a2d-8e8e-6d4a7b8d7cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:19 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Volume d3ef18d0-b7f3-4889-91f9-b302e53f8dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9', 'volume_size': 1} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:19 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256 1073741824" returned: 0 in 0.527s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:19 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1" returned: 0 in 0.443s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:19 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256 Jul 16 11:06:19 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:19 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1 Jul 16 11:06:19 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:19 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256" returned: 0 in 0.267s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-153561830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ef18d0-b7f3-4889-91f9-b302e53f8dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c3846a43194431b6d0ad3a6389f76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:19Z,use_quota=True,user_id='c4f4d0f4f26844588d5cfedebb0dcb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(768bfd26-0458-47c3-ac3b-d52c619737d3),volume_type_id=768bfd26-0458-47c3-ac3b-d52c619737d3)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Creating volume d3ef18d0-b7f3-4889-91f9-b302e53f8dd9 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:06:19 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:19 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c1479b79-f1d5-4473-befb-df1d0e9044b1" returned: 0 in 0.298s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:19 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9 1073741824 Jul 16 11:06:19 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60cec60-9a50-4947-ae5f-796bc3a52ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec344fa-fe7e-4619-bdfc-351d03f88d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-quobyte-c1479b79-f1d5-4473-befb-df1d0e9044b1" released by "delete_volume" :: held 0.820s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:06:19 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Volume volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256 (d0c08f33-c6b5-46dc-b728-edc6d0aed256): created successfully Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec344fa-fe7e-4619-bdfc-351d03f88d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Flow 'volume_create_manager' (2c4831fb-bd7a-45f0-9d81-9411ce9f993f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:19 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-984522bf-ac6a-4106-8d91-6a2812dd5fb4 tempest-TestInstancesWithCinderVolumes-1935085135 None] Created volume successfully. Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Created reservations ['d244c822-08a2-4baa-b68e-d3acc3625fbb', '10d23d22-242b-440c-8c61-4ea0e1834244', '18c0ce4e-7df4-41ce-9d1e-e5c912f4ffc7', 'fcc083ee-c5ce-46f7-91df-e2e1b32d0fbe'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:19 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:06:19 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "cinder-694bbf72-ff6c-4a4c-840d-523fb942967e-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-694bbf72-ff6c-4a4c-840d-523fb942967e-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Flow 'volume_create_manager' (78d15ce6-e3e0-4d34-b501-ccc3943be22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d33e071-2466-48d3-8ee8-f80ca6e59c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:20 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.405s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "cinder-quobyte-694bbf72-ff6c-4a4c-840d-523fb942967e" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:06:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Deleted volume successfully. Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d33e071-2466-48d3-8ee8-f80ca6e59c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-24631774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d2de96-750d-4029-bccf-9e8d138071d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c3846a43194431b6d0ad3a6389f76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:20Z,use_quota=True,user_id='c4f4d0f4f26844588d5cfedebb0dcb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3141bede-002d-4a8e-8289-e5b1b36652e9),volume_type_id=3141bede-002d-4a8e-8289-e5b1b36652e9)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c2f56b-b594-4a01-8f3a-1da1365a0537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c2f56b-b594-4a01-8f3a-1da1365a0537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439ded30-13ad-4090-97d8-2148d5da0cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.image.glance [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Creating Keystone auth plugin from conf {{(pid=87345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 11:06:20 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9 1073741824" returned: 0 in 0.767s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-quobyte-694bbf72-ff6c-4a4c-840d-523fb942967e" acquired by "delete_volume" :: waited 0.116s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a41c11f-e203-4206-baff-263820b18809]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-258dc8ff-64a2-4689-851e-29ad7175a150 tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-c1479b79-f1d5-4473-befb-df1d0e9044b1-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:20 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9 Jul 16 11:06:20 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:20 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e Jul 16 11:06:20 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:20 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9" returned: 0 in 0.380s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12bb21c-5839-4a2d-8e8e-6d4a7b8d7cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0431087c-1401-4e93-8eef-0aee8909c112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:20 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e" returned: 0 in 0.503s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439ded30-13ad-4090-97d8-2148d5da0cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '25d2de96-750d-4029-bccf-9e8d138071d5', 'volume_name': 'volume-25d2de96-750d-4029-bccf-9e8d138071d5', 'volume_size': 1, 'image_id': '55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1527599802', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6c3846a43194431b6d0ad3a6389f76c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'created_at': datetime.datetime(2026, 7, 16, 9, 6, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 6, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55efc83d-a083-4a62-8ca0-201ff3a2c3b9/file', 'properties': {}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:20 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e Jul 16 11:06:20 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80ba6c1-ff13-414e-bb9c-3a4894ac46f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80ba6c1-ff13-414e-bb9c-3a4894ac46f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867d57a1-e106-4dcc-a08d-800b5322a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:20 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Volume 25d2de96-750d-4029-bccf-9e8d138071d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-25d2de96-750d-4029-bccf-9e8d138071d5', 'volume_size': 1, 'image_id': '55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1527599802', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6c3846a43194431b6d0ad3a6389f76c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'created_at': datetime.datetime(2026, 7, 16, 9, 6, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 6, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55efc83d-a083-4a62-8ca0-201ff3a2c3b9/file', 'properties': {}}, 'image_service': } Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Trying to clone 25d2de96-750d-4029-bccf-9e8d138071d5 from image 55efc83d-a083-4a62-8ca0-201ff3a2c3b9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'metadata': {}}]). {{(pid=87345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 11:06:20 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Volume volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9 (d3ef18d0-b7f3-4889-91f9-b302e53f8dd9): created successfully Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0431087c-1401-4e93-8eef-0aee8909c112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Flow 'volume_create_manager' (2adf2698-e0fe-48f7-a59d-9fd9169f0222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-26223606-9b4c-42c3-a314-e6862721402b tempest-TestInstancesWithCinderVolumes-1935085135 None] Created volume successfully. Jul 16 11:06:21 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-694bbf72-ff6c-4a4c-840d-523fb942967e" returned: 0 in 0.475s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-quobyte-694bbf72-ff6c-4a4c-840d-523fb942967e" released by "delete_volume" :: held 1.037s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Created reservations ['849357ab-d1b7-429c-98de-73301bb58821', 'b951ab0a-7500-4c16-9450-421fdf6016a2', 'ea78f810-3ddc-490d-aa01-2c1363b0ee4e', '4e2746f1-8528-474a-a87d-75cc7b8c905e'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:21 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:06:21 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:21 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.367s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:06:21 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Deleted volume successfully. Jul 16 11:06:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d6eb0cd9-c211-4c6a-81b0-233b26cb8afa tempest-VolumesListTestJSON-1412297462 None] Lock "cinder-694bbf72-ff6c-4a4c-840d-523fb942967e-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD, size 20.69 MB, duration 5.15 sec {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 11:06:26 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Image download 20.69 MB at 4.02 MB/s Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35f40ed-3744-47a4-93bc-6d004f458ef9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:26 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD Jul 16 11:06:26 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:26 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Temporary image 55efc83d-a083-4a62-8ca0-201ff3a2c3b9 is fetched for user c4f4d0f4f26844588d5cfedebb0dcb0b. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e2e33c-373d-4d02-8cf9-9bd047a7b8a2]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:26 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD Jul 16 11:06:26 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Flow 'volume_create_manager' (b0dcc4de-a8e7-441b-b879-cce24809e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ba5465-6654-4bd3-9e16-c5508c308982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ba5465-6654-4bd3-9e16-c5508c308982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1066293695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ba545e-9daf-4bbe-be34-f69b2c9235ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b363312012f430b8944c5fd0e7458ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:27Z,use_quota=True,user_id='3b187e5e19ea4aff9221fa1ec7b03201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28d0c16-e2af-4314-ac2a-50157cc1c079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28d0c16-e2af-4314-ac2a-50157cc1c079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01c1720-6db0-424d-9397-f5452679393f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01c1720-6db0-424d-9397-f5452679393f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ba545e-9daf-4bbe-be34-f69b2c9235ca', 'volume_name': 'volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23221059-0565-4b39-a7ff-e5c18c47adb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23221059-0565-4b39-a7ff-e5c18c47adb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6131e4d-b3f6-4185-b5bf-c9d2879e3b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:26 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Volume c4ba545e-9daf-4bbe-be34-f69b2c9235ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca', 'volume_size': 1} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1066293695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ba545e-9daf-4bbe-be34-f69b2c9235ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b363312012f430b8944c5fd0e7458ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:27Z,use_quota=True,user_id='3b187e5e19ea4aff9221fa1ec7b03201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Creating volume c4ba545e-9daf-4bbe-be34-f69b2c9235ca {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:06:26 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:06:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:26 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca 1073741824 Jul 16 11:06:26 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:27 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:27 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca 1073741824" returned: 0 in 0.476s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:27 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca Jul 16 11:06:27 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:27 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca" returned: 0 in 0.261s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-24631774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d2de96-750d-4029-bccf-9e8d138071d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c3846a43194431b6d0ad3a6389f76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:20Z,use_quota=True,user_id='c4f4d0f4f26844588d5cfedebb0dcb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3141bede-002d-4a8e-8289-e5b1b36652e9),volume_type_id=3141bede-002d-4a8e-8289-e5b1b36652e9)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Creating volume 25d2de96-750d-4029-bccf-9e8d138071d5 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:06:27 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:27 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 1073741824 Jul 16 11:06:27 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6131e4d-b3f6-4185-b5bf-c9d2879e3b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44549c86-d9e7-4b55-92ff-59e85f915ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:27 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Volume volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca (c4ba545e-9daf-4bbe-be34-f69b2c9235ca): created successfully Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44549c86-d9e7-4b55-92ff-59e85f915ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Flow 'volume_create_manager' (b0dcc4de-a8e7-441b-b879-cce24809e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:27 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a426bbf6-e970-4727-80cd-d6e0a107d96f tempest-VolumesNegativeTest-637220470 None] Created volume successfully. Jul 16 11:06:28 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 1073741824" returned: 0 in 0.410s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:28 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 Jul 16 11:06:28 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:28 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5" returned: 0 in 0.268s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Attempting download of 55efc83d-a083-4a62-8ca0-201ff3a2c3b9 ((None, [{'url': 'file:///opt/stack/data/glance/images/55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'metadata': {}}])) to volume 25d2de96-750d-4029-bccf-9e8d138071d5. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca0291b-610c-4b08-9f46-b8e45fb88af0]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_c96shzq3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:28 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_c96shzq3 Jul 16 11:06:28 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:28 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Flow 'volume_create_manager' (26bc8e77-83b5-45ae-a5e3-42da10bae873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e09a9af-a883-4304-b264-c11f5e2fe1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_c96shzq3" returned: 0 in 0.426s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_c96shzq3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e09a9af-a883-4304-b264-c11f5e2fe1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-464316642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38caca94-422f-4927-80d6-37f0f1690ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1b1decda14aae9b843c91a99d9d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:29Z,use_quota=True,user_id='d0a8fa2efc964158851dba98ca513472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5c18f4-74e6-4c56-a13e-65c8a2bd3cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5c18f4-74e6-4c56-a13e-65c8a2bd3cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1a5b7b-08bb-452f-bbdd-92db1d64fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1a5b7b-08bb-452f-bbdd-92db1d64fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38caca94-422f-4927-80d6-37f0f1690ea2', 'volume_name': 'volume-38caca94-422f-4927-80d6-37f0f1690ea2', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f371a2ca-426d-4c76-a960-c54ce4d51967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f371a2ca-426d-4c76-a960-c54ce4d51967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3b565b-8923-4e8e-8467-2047055d840e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:29 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Volume 38caca94-422f-4927-80d6-37f0f1690ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38caca94-422f-4927-80d6-37f0f1690ea2', 'volume_size': 1} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-464316642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38caca94-422f-4927-80d6-37f0f1690ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1b1decda14aae9b843c91a99d9d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:06:29Z,use_quota=True,user_id='d0a8fa2efc964158851dba98ca513472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Creating volume 38caca94-422f-4927-80d6-37f0f1690ea2 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:06:29 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:29 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_c96shzq3 Jul 16 11:06:29 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:29 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2 1073741824 Jul 16 11:06:29 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:29 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_c96shzq3" returned: 1 in 0.379s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_c96shzq3' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f64e10-a911-4d5b-9821-18a59220f3be]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:29 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD Jul 16 11:06:29 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:29 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2 1073741824" returned: 0 in 0.596s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:29 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2 Jul 16 11:06:29 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:29 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] 55efc83d-a083-4a62-8ca0-201ff3a2c3b9 was qcow2, converting to qcow2 {{(pid=87345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 11:06:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:29 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 Jul 16 11:06:29 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:30 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2" returned: 0 in 0.341s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:06:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3b565b-8923-4e8e-8467-2047055d840e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38caca94-422f-4927-80d6-37f0f1690ea2', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82655bc3-0d5b-4043-9995-7c3be95ed1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:30 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Volume volume-38caca94-422f-4927-80d6-37f0f1690ea2 (38caca94-422f-4927-80d6-37f0f1690ea2): created successfully Jul 16 11:06:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82655bc3-0d5b-4043-9995-7c3be95ed1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Flow 'volume_create_manager' (26bc8e77-83b5-45ae-a5e3-42da10bae873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:30 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6fa99c0d-deb5-4af0-af3f-4a903194fd48 tempest-AttachVolumeNegativeTest-980360146 None] Created volume successfully. Jul 16 11:06:32 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5" returned: 0 in 2.532s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_55efc83d-a083-4a62-8ca0-201ff3a2c3b9_3iuxm6s_devstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:06:32 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Converted 112.00 MB image at 44.19 MB/s Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:32 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 1G Jul 16 11:06:32 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-38bf0b48-00e9-4fb3-ae9f-ba5138aed7f4 req-69c0a958-0db9-4d85-be05-f1290d86320a tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-38bf0b48-00e9-4fb3-ae9f-ba5138aed7f4 req-69c0a958-0db9-4d85-be05-f1290d86320a tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-38bf0b48-00e9-4fb3-ae9f-ba5138aed7f4 req-69c0a958-0db9-4d85-be05-f1290d86320a tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-38bf0b48-00e9-4fb3-ae9f-ba5138aed7f4 req-69c0a958-0db9-4d85-be05-f1290d86320a tempest-AttachVolumeNegativeTest-980360146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-38caca94-422f-4927-80d6-37f0f1690ea2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b288c33-e8b3-4870-a91e-411f3aa79003', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:06:32 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-38bf0b48-00e9-4fb3-ae9f-ba5138aed7f4 req-69c0a958-0db9-4d85-be05-f1290d86320a tempest-AttachVolumeNegativeTest-980360146 None] attachment_update completed successfully. Jul 16 11:06:32 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 1G" returned: 0 in 0.497s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Downloaded image 55efc83d-a083-4a62-8ca0-201ff3a2c3b9 ((None, [{'url': 'file:///opt/stack/data/glance/images/55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'metadata': {}}])) to volume 25d2de96-750d-4029-bccf-9e8d138071d5 successfully. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Temporary image 55efc83d-a083-4a62-8ca0-201ff3a2c3b9 for user c4f4d0f4f26844588d5cfedebb0dcb0b is deleted. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Marking volume 25d2de96-750d-4029-bccf-9e8d138071d5 as bootable. {{(pid=87345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Copying metadata from image 55efc83d-a083-4a62-8ca0-201ff3a2c3b9 to 25d2de96-750d-4029-bccf-9e8d138071d5. {{(pid=87345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Creating volume glance metadata for volume 25d2de96-750d-4029-bccf-9e8d138071d5 backed by image 55efc83d-a083-4a62-8ca0-201ff3a2c3b9 with: {'image_id': '55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'image_name': 'tempest-scenario-img--1527599802', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867d57a1-e106-4dcc-a08d-800b5322a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d2de96-750d-4029-bccf-9e8d138071d5', 'volume_size': 1, 'image_id': '55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1527599802', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd6c3846a43194431b6d0ad3a6389f76c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '55efc83d-a083-4a62-8ca0-201ff3a2c3b9', 'created_at': datetime.datetime(2026, 7, 16, 9, 6, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 6, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/55efc83d-a083-4a62-8ca0-201ff3a2c3b9/file', 'properties': {}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a30d3af-5655-462d-8956-13b534c6c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:06:33 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Volume volume-25d2de96-750d-4029-bccf-9e8d138071d5 (25d2de96-750d-4029-bccf-9e8d138071d5): created successfully Jul 16 11:06:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a30d3af-5655-462d-8956-13b534c6c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:06:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Flow 'volume_create_manager' (78d15ce6-e3e0-4d34-b501-ccc3943be22e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:06:33 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-cf4a7868-4d29-4b7c-b6b6-c58bced3747c tempest-TestInstancesWithCinderVolumes-1935085135 None] Created volume successfully. Jul 16 11:06:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:06:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:06:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:06:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:34 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:06:34 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:35 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.477s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:06:35 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:06:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:06:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:06:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-f1ef35eb-9f19-47f9-9cd2-9e358ce15ab8 req-7eed2f00-7582-4c41-bc25-7518aa2d260e tempest-AttachVolumeNegativeTest-980360146 None] Terminate volume connection completed successfully. Jul 16 11:06:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-f1ef35eb-9f19-47f9-9cd2-9e358ce15ab8 req-7eed2f00-7582-4c41-bc25-7518aa2d260e tempest-AttachVolumeNegativeTest-980360146 None] Deleting attachment 2b288c33-e8b3-4870-a91e-411f3aa79003. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:06:40 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=75,cinder:INSERT=16,cinder:SELECT=72,cinder:DELETE=8 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:06:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c57aa597-b313-42ff-9d24-5d8eeae1b97c req-b1ef61c0-2648-43bf-ba54-5c353d5a0279 tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:06:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c57aa597-b313-42ff-9d24-5d8eeae1b97c req-b1ef61c0-2648-43bf-ba54-5c353d5a0279 tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:06:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c57aa597-b313-42ff-9d24-5d8eeae1b97c req-b1ef61c0-2648-43bf-ba54-5c353d5a0279 tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:06:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-c57aa597-b313-42ff-9d24-5d8eeae1b97c req-b1ef61c0-2648-43bf-ba54-5c353d5a0279 tempest-TestInstancesWithCinderVolumes-1935085135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-25d2de96-750d-4029-bccf-9e8d138071d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3925d67-8861-4bf2-b957-a08b9b9eeb00', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:06:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-c57aa597-b313-42ff-9d24-5d8eeae1b97c req-b1ef61c0-2648-43bf-ba54-5c353d5a0279 tempest-TestInstancesWithCinderVolumes-1935085135 None] attachment_update completed successfully. Jul 16 11:06:46 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-6b41dac6-427e-4467-880f-a4bb4d73d30f req-ff5194ce-1159-477e-9324-21571b2a01f4 tempest-AttachVolumeTestJSON-792425831 None] Terminate volume connection completed successfully. Jul 16 11:06:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-6b41dac6-427e-4467-880f-a4bb4d73d30f req-ff5194ce-1159-477e-9324-21571b2a01f4 tempest-AttachVolumeTestJSON-792425831 None] Deleting attachment 7f15ef94-0b87-435b-ae84-48b37c9c0657. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:06:56 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:06:56 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=59,cinder:UPDATE=56,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:06:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Acquiring lock "cinder-c4ba545e-9daf-4bbe-be34-f69b2c9235ca-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:06:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Lock "cinder-c4ba545e-9daf-4bbe-be34-f69b2c9235ca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:06:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Acquiring lock "cinder-quobyte-c4ba545e-9daf-4bbe-be34-f69b2c9235ca" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:06:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Lock "cinder-quobyte-c4ba545e-9daf-4bbe-be34-f69b2c9235ca" acquired by "delete_volume" :: waited 0.031s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:06:59 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cd178b-35cd-4571-a269-7fbc9980083d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:06:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:59 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca Jul 16 11:06:59 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:06:59 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 16 11:06:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca" returned: 0 in 0.488s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:06:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:06:59 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca Jul 16 11:06:59 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:00 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4ba545e-9daf-4bbe-be34-f69b2c9235ca" returned: 0 in 0.409s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Lock "cinder-quobyte-c4ba545e-9daf-4bbe-be34-f69b2c9235ca" released by "delete_volume" :: held 0.994s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Created reservations ['a960074e-92c7-4846-b8bc-d359b498ae9b', 'cb021dbc-8306-4729-a072-b9d003882f50', 'b562a80c-ce92-4015-9189-b05407830125', '437fb182-346a-4449-abe9-03fd37b57279'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:00 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:07:00 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:00 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.574s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:07:00 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Deleted volume successfully. Jul 16 11:07:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f2c8fa08-2549-45d7-bed7-e42812343d98 tempest-VolumesNegativeTest-637220470 None] Lock "cinder-c4ba545e-9daf-4bbe-be34-f69b2c9235ca-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Flow 'volume_create_manager' (bc00b0ac-bd15-4c68-8079-6bada38d53b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33034c84-624d-4958-a126-4a60a7256390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33034c84-624d-4958-a126-4a60a7256390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2060027192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ccb4449-e6a5-4eee-bf77-fbb472d92603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9067d365493c407dba0a2f798df2ba47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:07:07Z,use_quota=True,user_id='46e7bfd3197f4ae1b15e099f1ca1ced3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58371f06-c458-4e9c-97e7-f441f4d627f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58371f06-c458-4e9c-97e7-f441f4d627f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f0d2cb-d268-408c-89ec-19ea0cad7f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f0d2cb-d268-408c-89ec-19ea0cad7f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ccb4449-e6a5-4eee-bf77-fbb472d92603', 'volume_name': 'volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8afcec2-d671-4bff-a0ff-045a60386120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8afcec2-d671-4bff-a0ff-045a60386120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241f0459-f840-49f3-b487-2e549ca681eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Volume 1ccb4449-e6a5-4eee-bf77-fbb472d92603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603', 'volume_size': 1} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2060027192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ccb4449-e6a5-4eee-bf77-fbb472d92603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9067d365493c407dba0a2f798df2ba47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:07:07Z,use_quota=True,user_id='46e7bfd3197f4ae1b15e099f1ca1ced3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Creating volume 1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:07:07 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:07:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:07 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 1073741824 Jul 16 11:07:07 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:08 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 1073741824" returned: 0 in 0.485s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:08 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 Jul 16 11:07:08 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:08 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603" returned: 0 in 0.378s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:07:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241f0459-f840-49f3-b487-2e549ca681eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f436cc8-c3ee-4f36-8fad-ace2396ab230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Volume volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 (1ccb4449-e6a5-4eee-bf77-fbb472d92603): created successfully Jul 16 11:07:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f436cc8-c3ee-4f36-8fad-ace2396ab230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Flow 'volume_create_manager' (bc00b0ac-bd15-4c68-8079-6bada38d53b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:07:08 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-36726a06-4b0f-4192-a187-4e28fd4145db tempest-VolumesSnapshotListTestJSON-1650553368 None] Created volume successfully. Jul 16 11:07:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] Creating offline snapshot 100f6d9e-c3c3-446f-af37-65ee2588b891 of volume 1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:07:09 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc7803c-3b52-4346-a5fe-df54f2e8c12b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:10 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 Jul 16 11:07:10 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:10 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603" returned: 0 in 0.380s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:10 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 1G Jul 16 11:07:10 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:10 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 1G" returned: 0 in 0.387s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:10 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 Jul 16 11:07:10 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:10 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891" returned: 0 in 0.321s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:11 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 is being set with open permissions: ugo+rw Jul 16 11:07:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:11 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 Jul 16 11:07:11 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:11 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:11 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.info Jul 16 11:07:11 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:11 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.info" returned: 0 in 0.262s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:11 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.info is being set with open permissions: ugo+rw Jul 16 11:07:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:11 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.info Jul 16 11:07:11 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:11 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.info" returned: 0 in 0.256s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:11 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-702888f9-0344-4f9f-ae27-f2df869b0100 tempest-VolumesSnapshotListTestJSON-1650553368 None] Create snapshot completed successfully Jul 16 11:07:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] Creating offline snapshot 15a7c35d-9937-4973-97cd-f20f50a12f0a of volume 1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:07:12 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a47953b-75e0-4b20-b16c-2f45cc5ec3b7]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:12 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 Jul 16 11:07:12 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:12 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891" returned: 0 in 0.407s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:07:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:12 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a 1G Jul 16 11:07:12 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:13 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a 1G" returned: 0 in 0.537s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:13 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a Jul 16 11:07:13 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:13 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a" returned: 0 in 0.314s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:13 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a is being set with open permissions: ugo+rw Jul 16 11:07:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:13 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a Jul 16 11:07:13 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:13 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a" returned: 0 in 0.266s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.634s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:13 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-17788fa3-53f0-4149-bc4f-d218687382dd tempest-VolumesSnapshotListTestJSON-1650553368 None] Create snapshot completed successfully Jul 16 11:07:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] Creating offline snapshot fddbee34-4135-4dd0-ab87-b41f9988870d of volume 1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:07:14 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffebbf89-dfe0-4c44-81b2-63d97ae37920]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:14 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a Jul 16 11:07:14 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:14 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a" returned: 0 in 0.418s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:07:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:14 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d 1G Jul 16 11:07:14 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:15 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d 1G" returned: 0 in 0.438s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:15 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d Jul 16 11:07:15 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:15 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d" returned: 0 in 0.274s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:15 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d is being set with open permissions: ugo+rw Jul 16 11:07:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:15 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d Jul 16 11:07:15 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:15 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.495s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-81d46a87-db20-474a-b675-dc8c07022cfc tempest-VolumesSnapshotListTestJSON-1650553368 None] Create snapshot completed successfully Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-1150ef51-1e83-41b3-bc19-9bb295d565a3 req-57d8ddbc-7c17-4349-8fc1-c405940a8166 tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-1150ef51-1e83-41b3-bc19-9bb295d565a3 req-57d8ddbc-7c17-4349-8fc1-c405940a8166 tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-1150ef51-1e83-41b3-bc19-9bb295d565a3 req-57d8ddbc-7c17-4349-8fc1-c405940a8166 tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-1150ef51-1e83-41b3-bc19-9bb295d565a3 req-57d8ddbc-7c17-4349-8fc1-c405940a8166 tempest-TestInstancesWithCinderVolumes-1935085135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55184c9d-8c39-42e1-96b8-42834408b488', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:07:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-1150ef51-1e83-41b3-bc19-9bb295d565a3 req-57d8ddbc-7c17-4349-8fc1-c405940a8166 tempest-TestInstancesWithCinderVolumes-1935085135 None] attachment_update completed successfully. Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "cinder-fddbee34-4135-4dd0-ab87-b41f9988870d-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-fddbee34-4135-4dd0-ab87-b41f9988870d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "cinder-quobyte-fddbee34-4135-4dd0-ab87-b41f9988870d" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-fddbee34-4135-4dd0-ab87-b41f9988870d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Deleting offline snapshot fddbee34-4135-4dd0-ab87-b41f9988870d of volume 1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] snapshot_file for this snap is: volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638df9c-193c-4ec0-8d27-1bd0aedc9f52]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:17 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d Jul 16 11:07:17 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:18 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d" returned: 0 in 0.515s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:07:18 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdb0a0a-5817-4ad3-a501-5443cc7a849b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:18 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a Jul 16 11:07:18 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:18 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a" returned: 0 in 0.379s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:07:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:18 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d Jul 16 11:07:18 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:18 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d" returned: 0 in 0.389s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:18 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d Jul 16 11:07:18 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:19 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.fddbee34-4135-4dd0-ab87-b41f9988870d" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-fddbee34-4135-4dd0-ab87-b41f9988870d" released by "_delete_snapshot" :: held 1.651s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" released by "delete_snapshot" :: held 1.688s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Created reservations ['9fc69cc0-16b3-469f-a538-e089c1356bae', 'ab3a8232-80a1-4353-9095-8ec37a573c35', '33cf708e-83ba-4db4-b250-b35ba5765aa3', '3d9ae99e-ab6e-41cf-98c0-ce53b6d8376a'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:07:19 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Delete snapshot completed successfully. Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-89c8c444-a43a-4ad2-916c-6bfd3d7b8b50 tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-fddbee34-4135-4dd0-ab87-b41f9988870d-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "cinder-15a7c35d-9937-4973-97cd-f20f50a12f0a-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-15a7c35d-9937-4973-97cd-f20f50a12f0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "cinder-quobyte-15a7c35d-9937-4973-97cd-f20f50a12f0a" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-15a7c35d-9937-4973-97cd-f20f50a12f0a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Deleting offline snapshot 15a7c35d-9937-4973-97cd-f20f50a12f0a of volume 1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] snapshot_file for this snap is: volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedf49db-6a34-4b71-a734-e2002a09fe46]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:19 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a Jul 16 11:07:19 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:20 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a" returned: 0 in 0.383s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d6a297-0ae7-4432-9955-2f38ce451e4e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-6d5ffd07-c677-420b-bd62-1c7b2e7f2036 req-d8a44549-da7e-4272-a53c-f4c0bb056929 tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-6d5ffd07-c677-420b-bd62-1c7b2e7f2036 req-d8a44549-da7e-4272-a53c-f4c0bb056929 tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-6d5ffd07-c677-420b-bd62-1c7b2e7f2036 req-d8a44549-da7e-4272-a53c-f4c0bb056929 tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-6d5ffd07-c677-420b-bd62-1c7b2e7f2036 req-d8a44549-da7e-4272-a53c-f4c0bb056929 tempest-TestInstancesWithCinderVolumes-1935085135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '725f6c70-c697-4bf1-8d8b-b2fdcf2c9657', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:07:20 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 Jul 16 11:07:20 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-6d5ffd07-c677-420b-bd62-1c7b2e7f2036 req-d8a44549-da7e-4272-a53c-f4c0bb056929 tempest-TestInstancesWithCinderVolumes-1935085135 None] attachment_update completed successfully. Jul 16 11:07:20 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891" returned: 0 in 0.383s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:20 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a Jul 16 11:07:20 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:20 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a" returned: 0 in 0.399s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:21 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a Jul 16 11:07:21 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:21 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.15a7c35d-9937-4973-97cd-f20f50a12f0a" returned: 0 in 0.282s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-15a7c35d-9937-4973-97cd-f20f50a12f0a" released by "_delete_snapshot" :: held 1.550s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" released by "delete_snapshot" :: held 1.580s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Created reservations ['b7892ff4-3343-4efd-a946-7348893bf73a', '483473e5-0222-4199-84a5-74c26d050214', '1fa364fc-aaa7-4039-9777-21199c99e2f7', '1e6047e3-70d2-4052-8501-cfafe413994a'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:07:21 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Delete snapshot completed successfully. Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4da2c68-cc5e-4955-b311-bcd21e83042b tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-15a7c35d-9937-4973-97cd-f20f50a12f0a-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "cinder-100f6d9e-c3c3-446f-af37-65ee2588b891-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-100f6d9e-c3c3-446f-af37-65ee2588b891-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "cinder-quobyte-100f6d9e-c3c3-446f-af37-65ee2588b891" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-100f6d9e-c3c3-446f-af37-65ee2588b891" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Deleting offline snapshot 100f6d9e-c3c3-446f-af37-65ee2588b891 of volume 1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] snapshot_file for this snap is: volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[39050af1-aa04-4276-97a9-b970ca683c41]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:22 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 Jul 16 11:07:22 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:22 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891" returned: 0 in 0.591s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:07:22 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[125861f1-ab31-4eef-97d0-fc569b3cd433]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:22 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 Jul 16 11:07:22 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:23 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603" returned: 0 in 0.436s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:23 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 Jul 16 11:07:23 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:23 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891" returned: 0 in 0.465s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:23 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891 Jul 16 11:07:23 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:23 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603.100f6d9e-c3c3-446f-af37-65ee2588b891" returned: 0 in 0.357s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-100f6d9e-c3c3-446f-af37-65ee2588b891" released by "_delete_snapshot" :: held 2.001s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" released by "delete_snapshot" :: held 2.060s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:24 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Created reservations ['9f946a63-984c-45b4-a205-67d664d813e2', '476014c4-43b0-4add-af52-75704ec9a1fa', '23f3639c-9dfc-47f0-9230-aac9d2eff6df', '13a9a6f8-7e66-446f-8a78-e8576632bfa8'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:07:24 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Delete snapshot completed successfully. Jul 16 11:07:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85bd7d07-494a-4ca6-8d45-b55498e002af tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-100f6d9e-c3c3-446f-af37-65ee2588b891-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "cinder-1ccb4449-e6a5-4eee-bf77-fbb472d92603-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-1ccb4449-e6a5-4eee-bf77-fbb472d92603-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6093cd-6300-4a5a-82fc-7e5529c6794a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:25 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 Jul 16 11:07:25 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:25 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-199be95a-fd1e-41e3-901b-330384134a0b req-243a08c3-3a48-4d22-afa3-19ebb8814d1e tempest-TestInstancesWithCinderVolumes-1935085135 None] Terminate volume connection completed successfully. Jul 16 11:07:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-199be95a-fd1e-41e3-901b-330384134a0b req-243a08c3-3a48-4d22-afa3-19ebb8814d1e tempest-TestInstancesWithCinderVolumes-1935085135 None] Deleting attachment 55184c9d-8c39-42e1-96b8-42834408b488. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:07:25 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603" returned: 0 in 0.532s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:25 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603 Jul 16 11:07:25 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:26 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1ccb4449-e6a5-4eee-bf77-fbb472d92603" returned: 0 in 0.257s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-quobyte-1ccb4449-e6a5-4eee-bf77-fbb472d92603" released by "delete_volume" :: held 0.855s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Created reservations ['922ab077-b6b3-4770-a93f-16bf3306f62e', '59113378-dc6d-4866-bdc8-fcde14a9b1c9', 'd6c31b58-76ec-4ecb-8ba6-0ee142ccee07', '9f503543-42a2-4401-b09b-38d11a2ddace'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:26 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:07:26 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "cinder-d0c08f33-c6b5-46dc-b728-edc6d0aed256-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-d0c08f33-c6b5-46dc-b728-edc6d0aed256-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "cinder-quobyte-d0c08f33-c6b5-46dc-b728-edc6d0aed256" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-quobyte-d0c08f33-c6b5-46dc-b728-edc6d0aed256" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8ca29d-5ca1-4050-a073-5b834d85b9a5]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:26 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.353s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:07:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Deleted volume successfully. Jul 16 11:07:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dd884d4d-db8d-4816-98e8-54e613ebac5a tempest-VolumesSnapshotListTestJSON-1650553368 None] Lock "cinder-1ccb4449-e6a5-4eee-bf77-fbb472d92603-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:26 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256 Jul 16 11:07:26 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:27 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256" returned: 0 in 0.504s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:27 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256 Jul 16 11:07:27 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Flow 'volume_create_manager' (f48d71d0-8a8a-48e0-99db-dd89fa9c43fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b78793d-128b-4e56-a7b6-eb3efc35a87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b78793d-128b-4e56-a7b6-eb3efc35a87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-648175363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fe51d7-a283-4782-ad9e-9aee24f7112c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1b1decda14aae9b843c91a99d9d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:07:27Z,use_quota=True,user_id='d0a8fa2efc964158851dba98ca513472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2c098a-5fe5-43b0-b739-12bf4dd9e0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2c098a-5fe5-43b0-b739-12bf4dd9e0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d090ba5-023d-43f2-b9b4-c5d27018b359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d090ba5-023d-43f2-b9b4-c5d27018b359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34fe51d7-a283-4782-ad9e-9aee24f7112c', 'volume_name': 'volume-34fe51d7-a283-4782-ad9e-9aee24f7112c', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34429ee7-bc4d-43d3-a9c8-ca7bda156e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34429ee7-bc4d-43d3-a9c8-ca7bda156e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0327066b-f009-439d-ad0f-a6faf67697f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:27 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Volume 34fe51d7-a283-4782-ad9e-9aee24f7112c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34fe51d7-a283-4782-ad9e-9aee24f7112c', 'volume_size': 1} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-648175363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fe51d7-a283-4782-ad9e-9aee24f7112c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c1b1decda14aae9b843c91a99d9d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:07:27Z,use_quota=True,user_id='d0a8fa2efc964158851dba98ca513472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Creating volume 34fe51d7-a283-4782-ad9e-9aee24f7112c {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:07:27 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:27 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0c08f33-c6b5-46dc-b728-edc6d0aed256" returned: 0 in 0.406s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:27 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c 1073741824 Jul 16 11:07:27 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-quobyte-d0c08f33-c6b5-46dc-b728-edc6d0aed256" released by "delete_volume" :: held 0.981s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:27 devstack cinder-volume[87345]: WARNING cinder.quota [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1108811856-265619339 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1108811856-265619339, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:07:27 devstack cinder-volume[87345]: WARNING cinder.quota [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1108811856-265619339 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1108811856-265619339, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Created reservations ['c2d90d5e-0c2e-4bc0-bc35-22b2d219930b', '7edd5beb-be41-4357-b7c5-5d3e98e8ac31', 'c313f4b3-3fc5-43ba-be38-6cdaa712888f', '804af309-b241-442e-84ad-6ad62b97aaf3'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:27 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:07:27 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:28 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.332s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:07:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Deleted volume successfully. Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-156a7799-1076-4659-8411-35a0dbca67de tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-d0c08f33-c6b5-46dc-b728-edc6d0aed256-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:28 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c 1073741824" returned: 0 in 0.685s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:28 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c Jul 16 11:07:28 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:28 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c" returned: 0 in 0.333s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0327066b-f009-439d-ad0f-a6faf67697f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34fe51d7-a283-4782-ad9e-9aee24f7112c', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418e10c2-5b40-4b4c-b0d8-21c67e82b829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:07:28 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Volume volume-34fe51d7-a283-4782-ad9e-9aee24f7112c (34fe51d7-a283-4782-ad9e-9aee24f7112c): created successfully Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418e10c2-5b40-4b4c-b0d8-21c67e82b829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:07:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Flow 'volume_create_manager' (f48d71d0-8a8a-48e0-99db-dd89fa9c43fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:07:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c2a79a25-c71b-4e8d-ab19-cd87954ca814 tempest-AttachVolumeNegativeTest-980360146 None] Created volume successfully. Jul 16 11:07:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-990ae705-2e96-47ac-b8ef-fc4970e2b222 req-6a94a31b-7f18-4b92-a651-28389d26cda8 tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-990ae705-2e96-47ac-b8ef-fc4970e2b222 req-6a94a31b-7f18-4b92-a651-28389d26cda8 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-990ae705-2e96-47ac-b8ef-fc4970e2b222 req-6a94a31b-7f18-4b92-a651-28389d26cda8 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-990ae705-2e96-47ac-b8ef-fc4970e2b222 req-6a94a31b-7f18-4b92-a651-28389d26cda8 tempest-AttachVolumeNegativeTest-980360146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-34fe51d7-a283-4782-ad9e-9aee24f7112c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad5261bf-52fd-468e-a3d7-51e82b702d46', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:07:30 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-990ae705-2e96-47ac-b8ef-fc4970e2b222 req-6a94a31b-7f18-4b92-a651-28389d26cda8 tempest-AttachVolumeNegativeTest-980360146 None] attachment_update completed successfully. Jul 16 11:07:31 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-f8b9f5f9-bf79-4d9d-a0e4-7e078579b46c req-1ec4152f-8455-4f5c-a07f-62bfb504c762 tempest-TestInstancesWithCinderVolumes-1935085135 None] Terminate volume connection completed successfully. Jul 16 11:07:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-f8b9f5f9-bf79-4d9d-a0e4-7e078579b46c req-1ec4152f-8455-4f5c-a07f-62bfb504c762 tempest-TestInstancesWithCinderVolumes-1935085135 None] Deleting attachment 725f6c70-c697-4bf1-8d8b-b2fdcf2c9657. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:07:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "cinder-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "cinder-quobyte-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-quobyte-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9" acquired by "delete_volume" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:32 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8d6135-f17b-4c11-aa2a-aed53ebde172]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:32 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9 Jul 16 11:07:32 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:32 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9" returned: 0 in 0.586s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:32 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9 Jul 16 11:07:32 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:32 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9" returned: 0 in 0.329s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-quobyte-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9" released by "delete_volume" :: held 0.984s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:33 devstack cinder-volume[87345]: WARNING cinder.quota [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1136869944-2037919613 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1136869944-2037919613, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:07:33 devstack cinder-volume[87345]: WARNING cinder.quota [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1136869944-2037919613 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1136869944-2037919613, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:07:33 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Created reservations ['38594450-d7be-482c-b10c-65892e385ce0', '0a310636-4e9e-4f68-b7de-3f62129004b1', '35a3c50e-b874-4749-908f-702f05998435', '514582ed-3873-4b20-9398-3113c6bcb599'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:07:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:07:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:07:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:33 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:07:33 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:33 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.331s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:33 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:07:33 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Deleted volume successfully. Jul 16 11:07:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4f573cc-df42-464b-8904-0ec017d9637a tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-d3ef18d0-b7f3-4889-91f9-b302e53f8dd9-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:33 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-2be22cf8-87a7-402d-98e3-a4599b3862df req-855b057d-6b26-4db8-9565-a29e513c7dc1 tempest-AttachVolumeNegativeTest-980360146 None] Terminate volume connection completed successfully. Jul 16 11:07:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-2be22cf8-87a7-402d-98e3-a4599b3862df req-855b057d-6b26-4db8-9565-a29e513c7dc1 tempest-AttachVolumeNegativeTest-980360146 None] Deleting attachment ad5261bf-52fd-468e-a3d7-51e82b702d46. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:34 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:07:34 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:34 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.323s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:07:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:07:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-10be27b0-7fb6-4126-a48c-806bf69f0816 req-80aeb740-b77b-46ea-bdf9-c534f21905de tempest-TestInstancesWithCinderVolumes-1935085135 None] Terminate volume connection completed successfully. Jul 16 11:07:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-10be27b0-7fb6-4126-a48c-806bf69f0816 req-80aeb740-b77b-46ea-bdf9-c534f21905de tempest-TestInstancesWithCinderVolumes-1935085135 None] Deleting attachment a3925d67-8861-4bf2-b957-a08b9b9eeb00. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "cinder-25d2de96-750d-4029-bccf-9e8d138071d5-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-25d2de96-750d-4029-bccf-9e8d138071d5-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "cinder-34fe51d7-a283-4782-ad9e-9aee24f7112c-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-34fe51d7-a283-4782-ad9e-9aee24f7112c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "cinder-quobyte-25d2de96-750d-4029-bccf-9e8d138071d5" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-quobyte-25d2de96-750d-4029-bccf-9e8d138071d5" acquired by "delete_volume" :: waited 0.044s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "cinder-quobyte-34fe51d7-a283-4782-ad9e-9aee24f7112c" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd4edb5-79df-4e79-bd6f-38e50deabcdf]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-quobyte-34fe51d7-a283-4782-ad9e-9aee24f7112c" acquired by "delete_volume" :: waited 0.053s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0e8cf0-380d-4651-b2c9-4a1d0c8e3fb2]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:42 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 Jul 16 11:07:42 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:42 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c Jul 16 11:07:42 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:43 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c" returned: 0 in 0.548s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:43 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c Jul 16 11:07:43 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:43 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5" returned: 0 in 0.734s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:43 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5 Jul 16 11:07:43 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:43 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34fe51d7-a283-4782-ad9e-9aee24f7112c" returned: 0 in 0.708s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:43 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-quobyte-34fe51d7-a283-4782-ad9e-9aee24f7112c" released by "delete_volume" :: held 1.329s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:43 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25d2de96-750d-4029-bccf-9e8d138071d5" returned: 0 in 0.686s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:43 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-quobyte-25d2de96-750d-4029-bccf-9e8d138071d5" released by "delete_volume" :: held 1.507s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Created reservations ['04a4627b-4f3b-40b2-9dc2-5d1827d739a2', '4747f584-5940-48a1-b538-a5dd7049de5a', '4030e99a-d3b5-41c0-b00e-43b72806a44e', '0702ca1b-c159-4197-b44b-4e3356559dc0'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:07:44 devstack cinder-volume[87345]: WARNING cinder.quota [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1724888767-286273153 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1724888767-286273153, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:07:44 devstack cinder-volume[87345]: WARNING cinder.quota [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1724888767-286273153 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1724888767-286273153, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Created reservations ['e169fa29-f85a-46b3-a099-389cd454d8f3', '55822b5e-d68b-4352-998b-6a694ea391cb', '4517379a-78c7-4c92-8805-99660c8b6bc0', 'ec785f1e-4258-4104-8b33-d59ce15dc965'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:44 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:07:44 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:44 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:07:44 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:44 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.422s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:07:44 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Deleted volume successfully. Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-86092939-9d78-4621-8191-1b28ea894ff9 tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-34fe51d7-a283-4782-ad9e-9aee24f7112c-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:44 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.463s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:07:44 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Deleted volume successfully. Jul 16 11:07:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e6999048-2678-4946-b81f-367a8637d5bc tempest-TestInstancesWithCinderVolumes-1935085135 None] Lock "cinder-25d2de96-750d-4029-bccf-9e8d138071d5-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "cinder-38caca94-422f-4927-80d6-37f0f1690ea2-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-38caca94-422f-4927-80d6-37f0f1690ea2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "cinder-quobyte-38caca94-422f-4927-80d6-37f0f1690ea2" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-quobyte-38caca94-422f-4927-80d6-37f0f1690ea2" acquired by "delete_volume" :: waited 0.060s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:45 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0b4485-64ba-4873-8891-7a0fe9825178]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:45 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2 Jul 16 11:07:45 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:46 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2" returned: 0 in 0.668s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:46 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2 Jul 16 11:07:46 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:46 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-38caca94-422f-4927-80d6-37f0f1690ea2" returned: 0 in 0.341s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-quobyte-38caca94-422f-4927-80d6-37f0f1690ea2" released by "delete_volume" :: held 1.122s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:46 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Created reservations ['2f7eeb29-f962-4c09-a97a-54b12a429ee3', 'ef7eb1fb-dea8-4a1b-a40e-ecbbc60670df', '6494f293-b7c5-459b-9ba2-6c26a9e6badd', '6e811f20-6b71-4c5f-8533-0be9b9122144'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:07:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:07:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:07:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:46 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:07:46 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:47 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.491s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:47 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:07:47 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Deleted volume successfully. Jul 16 11:07:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0e5f9ef9-aa72-4893-ae23-13e8246649ea tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-38caca94-422f-4927-80d6-37f0f1690ea2-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "cinder-d0d33c32-12ac-4a72-bb26-16e5679dc6c2-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-d0d33c32-12ac-4a72-bb26-16e5679dc6c2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "cinder-quobyte-d0d33c32-12ac-4a72-bb26-16e5679dc6c2" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:07:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-quobyte-d0d33c32-12ac-4a72-bb26-16e5679dc6c2" acquired by "delete_volume" :: waited 0.027s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:07:48 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3488672-f71e-4fef-8095-8b3bef9414a2]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:07:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:48 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2 Jul 16 11:07:48 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:48 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2" returned: 0 in 0.564s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:48 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2 Jul 16 11:07:48 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:49 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0d33c32-12ac-4a72-bb26-16e5679dc6c2" returned: 0 in 0.356s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-quobyte-d0d33c32-12ac-4a72-bb26-16e5679dc6c2" released by "delete_volume" :: held 0.998s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Created reservations ['2f559b82-dcc0-45c3-af84-d55aaa84c7b0', '09282956-305f-41e0-be5c-cbed8408872f', 'ff485de4-8d30-4ea6-8e4f-86c67e0bd334', '9ecac474-757c-4ce0-a137-fd968382c958'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:07:49 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:07:49 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:07:49 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.323s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:07:49 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Deleted volume successfully. Jul 16 11:07:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b3d8def1-cee5-4291-aa8a-fd8c7eba5e3f tempest-AttachVolumeNegativeTest-980360146 None] Lock "cinder-d0d33c32-12ac-4a72-bb26-16e5679dc6c2-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:07:59 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=99,cinder:UPDATE=98,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:07:59 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=83,cinder:INSERT=25,cinder:UPDATE=92,cinder:DELETE=5 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:08:04 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Flow 'volume_create_manager' (faf89a05-43dc-4c20-9e26-93f38ea39025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8b15ce-b1bc-4a49-beee-1349ae88c136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8b15ce-b1bc-4a49-beee-1349ae88c136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059913585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4da740c-908d-4701-8ac0-556785b62bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25870c881cd9421ea8df7698d5f193a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:05Z,use_quota=True,user_id='5ab4f3d7b73d4f79886c56f46a701d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2348157c-0582-4124-bdcf-fe7f7b5d8efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2348157c-0582-4124-bdcf-fe7f7b5d8efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2516cb79-2738-4d40-8c6f-5ab49ccaa685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2516cb79-2738-4d40-8c6f-5ab49ccaa685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4da740c-908d-4701-8ac0-556785b62bf6', 'volume_name': 'volume-d4da740c-908d-4701-8ac0-556785b62bf6', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f9a890-28a3-49db-81a6-0afb739f1b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f9a890-28a3-49db-81a6-0afb739f1b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3ca654-2259-43d0-9fd7-39ce621d3c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:05 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Volume d4da740c-908d-4701-8ac0-556785b62bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4da740c-908d-4701-8ac0-556785b62bf6', 'volume_size': 1} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059913585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4da740c-908d-4701-8ac0-556785b62bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25870c881cd9421ea8df7698d5f193a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:05Z,use_quota=True,user_id='5ab4f3d7b73d4f79886c56f46a701d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Creating volume d4da740c-908d-4701-8ac0-556785b62bf6 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:05 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:05 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6 1073741824 Jul 16 11:08:05 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Flow 'volume_create_manager' (104cf767-afcb-4065-a718-a13b5b32bd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25f0e09-ec47-4e93-bb14-f54ad85e00d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25f0e09-ec47-4e93-bb14-f54ad85e00d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-708016273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7346f49-87ed-45f8-b04d-315d834514da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25870c881cd9421ea8df7698d5f193a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:06Z,use_quota=True,user_id='5ab4f3d7b73d4f79886c56f46a701d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a234b9ae-974b-4bda-8e6a-afaa6626ea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a234b9ae-974b-4bda-8e6a-afaa6626ea28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ba4f16-3759-4ba8-9682-b74cc2a1f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ba4f16-3759-4ba8-9682-b74cc2a1f185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7346f49-87ed-45f8-b04d-315d834514da', 'volume_name': 'volume-f7346f49-87ed-45f8-b04d-315d834514da', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d9c7d1-5bda-4397-98e1-97816084597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d9c7d1-5bda-4397-98e1-97816084597e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a962aa29-a72b-4e24-ac59-ec59b2a2a55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:05 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Volume f7346f49-87ed-45f8-b04d-315d834514da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7346f49-87ed-45f8-b04d-315d834514da', 'volume_size': 1} Jul 16 11:08:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:06 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6 1073741824" returned: 0 in 0.936s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:06 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6 Jul 16 11:08:06 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Flow 'volume_create_manager' (21a406ee-2d11-425f-a7b1-ddf2b6287519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379e0e5a-684b-46f4-81b6-0dfb2bd3e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379e0e5a-684b-46f4-81b6-0dfb2bd3e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687194520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8d5db9-2ff0-4fd5-868d-32737cf55c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25870c881cd9421ea8df7698d5f193a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:06Z,use_quota=True,user_id='5ab4f3d7b73d4f79886c56f46a701d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784547bb-ba44-49d3-8b0a-7e11c45535c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784547bb-ba44-49d3-8b0a-7e11c45535c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:06 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a6dc87-dd1e-4ed2-8f06-ac12f54f7d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a6dc87-dd1e-4ed2-8f06-ac12f54f7d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d8d5db9-2ff0-4fd5-868d-32737cf55c52', 'volume_name': 'volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660449bd-a323-434e-bc60-4ead893a8986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660449bd-a323-434e-bc60-4ead893a8986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffc2520-f835-4975-b814-f69bf589c65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:06 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Volume 8d8d5db9-2ff0-4fd5-868d-32737cf55c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52', 'volume_size': 1} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6" returned: 0 in 0.519s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.770s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-708016273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7346f49-87ed-45f8-b04d-315d834514da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25870c881cd9421ea8df7698d5f193a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:06Z,use_quota=True,user_id='5ab4f3d7b73d4f79886c56f46a701d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Creating volume f7346f49-87ed-45f8-b04d-315d834514da {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:06 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:06 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da 1073741824 Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3ca654-2259-43d0-9fd7-39ce621d3c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4da740c-908d-4701-8ac0-556785b62bf6', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:06 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05172b51-ccff-41ba-a38f-9a0f414cba6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:06 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Volume volume-d4da740c-908d-4701-8ac0-556785b62bf6 (d4da740c-908d-4701-8ac0-556785b62bf6): created successfully Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05172b51-ccff-41ba-a38f-9a0f414cba6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Flow 'volume_create_manager' (faf89a05-43dc-4c20-9e26-93f38ea39025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:06 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8a141441-a3c4-46c4-a3d3-6c6ba7b7cecd tempest-CreateVolumesFromImageTest-627994304 None] Created volume successfully. Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Flow 'volume_create_manager' (901e382a-0484-4cb6-86a0-317b2d79cae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e190332d-52e6-41ab-9c0b-e788419eac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e190332d-52e6-41ab-9c0b-e788419eac1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-496884493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abadfb1-d127-400d-80fc-54f197afb556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f071c3d67a8646ca92a9becba4c38702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:07Z,use_quota=True,user_id='f362fbe5a02c44e9a87c8c99dacc5053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42151de3-6ddd-4b79-89f6-974d9cd843a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42151de3-6ddd-4b79-89f6-974d9cd843a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edb5a3e-ff36-49c9-b0e3-02f06707c3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edb5a3e-ff36-49c9-b0e3-02f06707c3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2abadfb1-d127-400d-80fc-54f197afb556', 'volume_name': 'volume-2abadfb1-d127-400d-80fc-54f197afb556', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df64ad80-3d7d-4c47-bc29-147e8a915146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df64ad80-3d7d-4c47-bc29-147e8a915146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b484befc-dd42-478a-967c-74ad1e8ebe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Volume 2abadfb1-d127-400d-80fc-54f197afb556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2abadfb1-d127-400d-80fc-54f197afb556', 'volume_size': 1} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Flow 'volume_create_manager' (982965f8-4f50-43c5-9d15-7881cddfdb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe99047-4db3-4f73-8924-92fa01be2816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe99047-4db3-4f73-8924-92fa01be2816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-190484150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25870c881cd9421ea8df7698d5f193a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:07Z,use_quota=True,user_id='5ab4f3d7b73d4f79886c56f46a701d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4708a64-95f7-430f-8828-08aa0cc7946a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4708a64-95f7-430f-8828-08aa0cc7946a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b62e640-f261-422a-984a-70343ef282db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b62e640-f261-422a-984a-70343ef282db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012', 'volume_name': 'volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c12e649-c45d-44d3-9b8d-0c17c45e6fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c12e649-c45d-44d3-9b8d-0c17c45e6fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3cc82ec-6cbb-4415-97d2-57decb29c2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Volume cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012', 'volume_size': 1} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Flow 'volume_create_manager' (56c2f7ca-ef11-4b58-8c26-b2e77df27f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31de28b2-741e-48a6-adcd-06a904724159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31de28b2-741e-48a6-adcd-06a904724159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2028846753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab05047-3d5a-4b96-8e8f-163f1ef979b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25870c881cd9421ea8df7698d5f193a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:07Z,use_quota=True,user_id='5ab4f3d7b73d4f79886c56f46a701d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91947b18-81fd-4987-96ce-78826d513067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91947b18-81fd-4987-96ce-78826d513067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7915db6c-c989-4dc5-8a55-1b81d03f4d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7915db6c-c989-4dc5-8a55-1b81d03f4d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab05047-3d5a-4b96-8e8f-163f1ef979b0', 'volume_name': 'volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213e5a93-9018-4383-a48d-00ea9446d51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213e5a93-9018-4383-a48d-00ea9446d51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92238ef5-c3ce-4c71-8da6-a4c4f7cbb7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Volume 7ab05047-3d5a-4b96-8e8f-163f1ef979b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0', 'volume_size': 1} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da 1073741824" returned: 0 in 0.947s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:07 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da Jul 16 11:08:07 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:07 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da" returned: 0 in 0.286s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.323s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687194520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8d5db9-2ff0-4fd5-868d-32737cf55c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25870c881cd9421ea8df7698d5f193a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:06Z,use_quota=True,user_id='5ab4f3d7b73d4f79886c56f46a701d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Creating volume 8d8d5db9-2ff0-4fd5-868d-32737cf55c52 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:07 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a962aa29-a72b-4e24-ac59-ec59b2a2a55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7346f49-87ed-45f8-b04d-315d834514da', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:08 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52 1073741824 Jul 16 11:08:08 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8d9a06-e334-4fc2-8a55-c9dd37a7ea56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Volume volume-f7346f49-87ed-45f8-b04d-315d834514da (f7346f49-87ed-45f8-b04d-315d834514da): created successfully Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8d9a06-e334-4fc2-8a55-c9dd37a7ea56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Flow 'volume_create_manager' (104cf767-afcb-4065-a718-a13b5b32bd15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:08 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-31845b11-442e-470d-b255-98e62578b16f tempest-CreateVolumesFromImageTest-627994304 None] Created volume successfully. Jul 16 11:08:08 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52 1073741824" returned: 0 in 0.620s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:08 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52 Jul 16 11:08:08 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:08 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52" returned: 0 in 0.285s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.799s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-496884493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abadfb1-d127-400d-80fc-54f197afb556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f071c3d67a8646ca92a9becba4c38702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:07Z,use_quota=True,user_id='f362fbe5a02c44e9a87c8c99dacc5053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Creating volume 2abadfb1-d127-400d-80fc-54f197afb556 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:08 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffc2520-f835-4975-b814-f69bf589c65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:08 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556 1073741824 Jul 16 11:08:08 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a2e127-a93e-478e-89e7-40700710660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Volume volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52 (8d8d5db9-2ff0-4fd5-868d-32737cf55c52): created successfully Jul 16 11:08:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a2e127-a93e-478e-89e7-40700710660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Flow 'volume_create_manager' (21a406ee-2d11-425f-a7b1-ddf2b6287519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-45042313-8f66-4715-b9bc-6ed216ae30cd tempest-CreateVolumesFromImageTest-627994304 None] Created volume successfully. Jul 16 11:08:09 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556 1073741824" returned: 0 in 0.758s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:09 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556 Jul 16 11:08:09 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:09 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556" returned: 0 in 0.273s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.616s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-190484150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25870c881cd9421ea8df7698d5f193a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:07Z,use_quota=True,user_id='5ab4f3d7b73d4f79886c56f46a701d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Creating volume cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:10 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b484befc-dd42-478a-967c-74ad1e8ebe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2abadfb1-d127-400d-80fc-54f197afb556', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb99cce-af79-49b8-8a02-e3a4d799e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:10 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012 1073741824 Jul 16 11:08:10 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:10 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Volume volume-2abadfb1-d127-400d-80fc-54f197afb556 (2abadfb1-d127-400d-80fc-54f197afb556): created successfully Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb99cce-af79-49b8-8a02-e3a4d799e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Flow 'volume_create_manager' (901e382a-0484-4cb6-86a0-317b2d79cae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:10 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ad05fa64-a3ac-4295-b430-904af9850506 tempest-AttachVolumeTestJSON-792425831 None] Created volume successfully. Jul 16 11:08:10 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012 1073741824" returned: 0 in 0.563s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:10 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012 Jul 16 11:08:10 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:11 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012" returned: 0 in 0.382s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.456s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2028846753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab05047-3d5a-4b96-8e8f-163f1ef979b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25870c881cd9421ea8df7698d5f193a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:07Z,use_quota=True,user_id='5ab4f3d7b73d4f79886c56f46a701d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Creating volume 7ab05047-3d5a-4b96-8e8f-163f1ef979b0 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:11 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3cc82ec-6cbb-4415-97d2-57decb29c2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c71fbde-9bd3-403f-9d9a-5a3e7fb9ae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:11 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0 1073741824 Jul 16 11:08:11 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:11 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Volume volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012 (cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012): created successfully Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c71fbde-9bd3-403f-9d9a-5a3e7fb9ae26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Flow 'volume_create_manager' (982965f8-4f50-43c5-9d15-7881cddfdb07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:11 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-88b5f934-e03f-4892-b67d-8398f9f07fde tempest-CreateVolumesFromImageTest-627994304 None] Created volume successfully. Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-469871e9-4d9c-471d-bed4-1f6e32e47ba3 req-cf24c434-763e-493a-9199-356d61f78bad tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:11 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0 1073741824" returned: 0 in 0.853s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:12 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0 Jul 16 11:08:12 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:12 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0" returned: 0 in 0.524s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-469871e9-4d9c-471d-bed4-1f6e32e47ba3 req-cf24c434-763e-493a-9199-356d61f78bad tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.759s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-469871e9-4d9c-471d-bed4-1f6e32e47ba3 req-cf24c434-763e-493a-9199-356d61f78bad tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92238ef5-c3ce-4c71-8da6-a4c4f7cbb7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfc5754-3857-4326-ac00-7aca25fdbebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:12 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Volume volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0 (7ab05047-3d5a-4b96-8e8f-163f1ef979b0): created successfully Jul 16 11:08:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfc5754-3857-4326-ac00-7aca25fdbebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Flow 'volume_create_manager' (56c2f7ca-ef11-4b58-8c26-b2e77df27f6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-469871e9-4d9c-471d-bed4-1f6e32e47ba3 req-cf24c434-763e-493a-9199-356d61f78bad tempest-AttachVolumeTestJSON-792425831 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-2abadfb1-d127-400d-80fc-54f197afb556', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'efa3443c-f895-4283-9e9c-2975ddcbbdcb', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:08:12 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a909d996-cb02-4d79-963a-ae15b2dbb44d tempest-CreateVolumesFromImageTest-627994304 None] Created volume successfully. Jul 16 11:08:12 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-469871e9-4d9c-471d-bed4-1f6e32e47ba3 req-cf24c434-763e-493a-9199-356d61f78bad tempest-AttachVolumeTestJSON-792425831 None] attachment_update completed successfully. Jul 16 11:08:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "cinder-7ab05047-3d5a-4b96-8e8f-163f1ef979b0-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-7ab05047-3d5a-4b96-8e8f-163f1ef979b0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "cinder-quobyte-7ab05047-3d5a-4b96-8e8f-163f1ef979b0" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-quobyte-7ab05047-3d5a-4b96-8e8f-163f1ef979b0" acquired by "delete_volume" :: waited 0.062s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:13 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ef080e-c6a5-4a0f-b6a9-d5c746fbae6a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:14 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0 Jul 16 11:08:14 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:14 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0" returned: 0 in 0.624s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:14 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0 Jul 16 11:08:14 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:14 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ab05047-3d5a-4b96-8e8f-163f1ef979b0" returned: 0 in 0.283s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-quobyte-7ab05047-3d5a-4b96-8e8f-163f1ef979b0" released by "delete_volume" :: held 1.038s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:14 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Created reservations ['dd792caf-fd1e-4fac-a69f-82eeaf449563', 'deacded2-d5ac-49d1-b738-525f45d5f5a5', 'df2d108b-74aa-4b3e-9cdb-047cd8b9ca4c', '74f4393a-6bbb-46f2-8c14-40fd1071ace0'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:15 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:15 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:15 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.517s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:15 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Deleted volume successfully. Jul 16 11:08:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9d7bd1f4-acb3-4d64-bdbc-73a5b1e634c4 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-7ab05047-3d5a-4b96-8e8f-163f1ef979b0-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "cinder-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "cinder-quobyte-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Flow 'volume_create_manager' (2ab243d6-b8ad-46cb-a765-4a71957b4b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f25894-d9f2-43a2-8d4a-1a4661e5cb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-quobyte-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012" acquired by "delete_volume" :: waited 0.098s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f25894-d9f2-43a2-8d4a-1a4661e5cb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-182133131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89afae3f-44db-4d9b-b73b-9b77521aac38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f071c3d67a8646ca92a9becba4c38702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:16Z,use_quota=True,user_id='f362fbe5a02c44e9a87c8c99dacc5053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b0c8e6-227b-4a40-a4b3-cb710099b883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b0c8e6-227b-4a40-a4b3-cb710099b883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cef935-9c79-4f20-ba99-d3862d7c0157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cef935-9c79-4f20-ba99-d3862d7c0157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89afae3f-44db-4d9b-b73b-9b77521aac38', 'volume_name': 'volume-89afae3f-44db-4d9b-b73b-9b77521aac38', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e3effc-ea95-4b38-a907-23a35df687cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e3effc-ea95-4b38-a907-23a35df687cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2499334-f13a-469e-837a-53359628970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:16 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Volume 89afae3f-44db-4d9b-b73b-9b77521aac38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89afae3f-44db-4d9b-b73b-9b77521aac38', 'volume_size': 1} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-182133131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89afae3f-44db-4d9b-b73b-9b77521aac38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f071c3d67a8646ca92a9becba4c38702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:16Z,use_quota=True,user_id='f362fbe5a02c44e9a87c8c99dacc5053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Creating volume 89afae3f-44db-4d9b-b73b-9b77521aac38 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:16 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b5d81d-af67-42f5-bf3c-9debc52923dd]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:16 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38 1073741824 Jul 16 11:08:16 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:16 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012 Jul 16 11:08:16 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:16 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012" returned: 0 in 0.548s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:16 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012 Jul 16 11:08:16 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:17 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38 1073741824" returned: 0 in 0.704s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:17 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38 Jul 16 11:08:17 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:17 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012" returned: 0 in 0.411s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-quobyte-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012" released by "delete_volume" :: held 1.143s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Created reservations ['eb39e47d-0494-47b6-b017-7c5df99685a6', 'c55a723a-f21b-475a-940c-54af0ca12108', '9218caea-7c6f-4697-90ae-13476dd029f1', '33a54046-686e-41c6-8cd2-6c29d0768fe9'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:17 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38" returned: 0 in 0.444s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:17 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:17 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2499334-f13a-469e-837a-53359628970e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89afae3f-44db-4d9b-b73b-9b77521aac38', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd08b54-bf20-487c-9dbf-eff9dedfe077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:17 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Volume volume-89afae3f-44db-4d9b-b73b-9b77521aac38 (89afae3f-44db-4d9b-b73b-9b77521aac38): created successfully Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd08b54-bf20-487c-9dbf-eff9dedfe077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Flow 'volume_create_manager' (2ab243d6-b8ad-46cb-a765-4a71957b4b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-fadb513a-3153-4a5c-9f09-0a8944dc5419 tempest-AttachVolumeTestJSON-792425831 None] Created volume successfully. Jul 16 11:08:17 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.412s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:17 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Deleted volume successfully. Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-432567a6-bc9e-4c2b-aebf-ab090c84b299 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-cd8e5f9b-cff1-4a6d-b87d-c8b7dc966012-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Flow 'volume_create_manager' (65076f49-51c0-46b5-9726-37376abf7b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010ac694-0c0c-4342-861f-6df0135bb591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010ac694-0c0c-4342-861f-6df0135bb591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-45632038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e9cc78-5b91-4346-a110-e382d74a6d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef7b629b84e4d6d83f911b1938f9c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:18Z,use_quota=True,user_id='bfc2a3daaf704055bf0baedf2c5f7d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836ce4b8-89e1-49a6-8cd1-5c03d116bcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836ce4b8-89e1-49a6-8cd1-5c03d116bcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c66d85-c67c-4d8b-ab82-7789031c4d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c66d85-c67c-4d8b-ab82-7789031c4d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e9cc78-5b91-4346-a110-e382d74a6d22', 'volume_name': 'volume-e1e9cc78-5b91-4346-a110-e382d74a6d22', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4da7a3-d9ad-47ff-bdba-0d26bb8fedfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4da7a3-d9ad-47ff-bdba-0d26bb8fedfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3413d1b7-0919-4e71-8367-681825a7159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:18 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Volume e1e9cc78-5b91-4346-a110-e382d74a6d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e9cc78-5b91-4346-a110-e382d74a6d22', 'volume_size': 1} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-45632038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e9cc78-5b91-4346-a110-e382d74a6d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef7b629b84e4d6d83f911b1938f9c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:18Z,use_quota=True,user_id='bfc2a3daaf704055bf0baedf2c5f7d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Creating volume e1e9cc78-5b91-4346-a110-e382d74a6d22 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:18 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:18 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22 1073741824 Jul 16 11:08:18 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "cinder-8d8d5db9-2ff0-4fd5-868d-32737cf55c52-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-8d8d5db9-2ff0-4fd5-868d-32737cf55c52-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "cinder-quobyte-8d8d5db9-2ff0-4fd5-868d-32737cf55c52" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-quobyte-8d8d5db9-2ff0-4fd5-868d-32737cf55c52" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[50436577-2187-42e3-b755-3d8f263ca0d0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:18 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52 Jul 16 11:08:18 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:18 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22 1073741824" returned: 0 in 0.693s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:18 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22 Jul 16 11:08:18 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:19 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52" returned: 0 in 0.562s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:19 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52 Jul 16 11:08:19 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:19 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22" returned: 0 in 0.510s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3413d1b7-0919-4e71-8367-681825a7159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e9cc78-5b91-4346-a110-e382d74a6d22', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df9d24b-b651-4ddc-ae5e-ebc26f9f7fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:19 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Volume volume-e1e9cc78-5b91-4346-a110-e382d74a6d22 (e1e9cc78-5b91-4346-a110-e382d74a6d22): created successfully Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df9d24b-b651-4ddc-ae5e-ebc26f9f7fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Flow 'volume_create_manager' (65076f49-51c0-46b5-9726-37376abf7b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-6ea653c2-e0c8-4856-ab4e-d2033295c5be req-646ff434-941d-4128-9313-3f4fcd450fda tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-6ea653c2-e0c8-4856-ab4e-d2033295c5be req-646ff434-941d-4128-9313-3f4fcd450fda tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:19 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-521efa9d-18a3-441f-b57f-93c0932ea914 tempest-TestMinimumBasicScenario-969644819 None] Created volume successfully. Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-6ea653c2-e0c8-4856-ab4e-d2033295c5be req-646ff434-941d-4128-9313-3f4fcd450fda tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:19 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d8d5db9-2ff0-4fd5-868d-32737cf55c52" returned: 0 in 0.519s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-6ea653c2-e0c8-4856-ab4e-d2033295c5be req-646ff434-941d-4128-9313-3f4fcd450fda tempest-AttachVolumeTestJSON-792425831 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-89afae3f-44db-4d9b-b73b-9b77521aac38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c389b36-a91e-47a4-9835-cf3af2e34d3c', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-quobyte-8d8d5db9-2ff0-4fd5-868d-32737cf55c52" released by "delete_volume" :: held 1.142s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:19 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-6ea653c2-e0c8-4856-ab4e-d2033295c5be req-646ff434-941d-4128-9313-3f4fcd450fda tempest-AttachVolumeTestJSON-792425831 None] attachment_update completed successfully. Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Created reservations ['7516045c-f9f3-4e64-81d1-c785777b8dd4', 'd47e2b22-e225-4080-82ef-125c82845ad8', '170a2982-dfcd-4f2a-a549-8ca93f1406fd', 'af0fefd5-f5a0-4893-bba3-21249aa8c04b'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:19 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:19 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:20 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.330s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:20 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Deleted volume successfully. Jul 16 11:08:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ee666ec-adbd-4944-aa3c-620e9a48a40c tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-8d8d5db9-2ff0-4fd5-868d-32737cf55c52-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "cinder-f7346f49-87ed-45f8-b04d-315d834514da-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-f7346f49-87ed-45f8-b04d-315d834514da-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "cinder-quobyte-f7346f49-87ed-45f8-b04d-315d834514da" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-quobyte-f7346f49-87ed-45f8-b04d-315d834514da" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47087e8-0908-429b-a9c0-0d75f63855d2]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:21 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da Jul 16 11:08:21 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:21 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da" returned: 0 in 0.561s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:21 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da Jul 16 11:08:21 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-cfd4ebe4-f8ea-4cf8-9f52-42860e325552 req-65211cbf-ed13-4df6-9708-e811cea42327 tempest-TestMinimumBasicScenario-969644819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-cfd4ebe4-f8ea-4cf8-9f52-42860e325552 req-65211cbf-ed13-4df6-9708-e811cea42327 tempest-TestMinimumBasicScenario-969644819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-cfd4ebe4-f8ea-4cf8-9f52-42860e325552 req-65211cbf-ed13-4df6-9708-e811cea42327 tempest-TestMinimumBasicScenario-969644819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-cfd4ebe4-f8ea-4cf8-9f52-42860e325552 req-65211cbf-ed13-4df6-9708-e811cea42327 tempest-TestMinimumBasicScenario-969644819 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-e1e9cc78-5b91-4346-a110-e382d74a6d22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b17a9ac-acd9-4466-b578-c8a76ee850a9', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:08:22 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f7346f49-87ed-45f8-b04d-315d834514da" returned: 0 in 0.502s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-quobyte-f7346f49-87ed-45f8-b04d-315d834514da" released by "delete_volume" :: held 1.154s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:22 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-cfd4ebe4-f8ea-4cf8-9f52-42860e325552 req-65211cbf-ed13-4df6-9708-e811cea42327 tempest-TestMinimumBasicScenario-969644819 None] attachment_update completed successfully. Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Created reservations ['e7825f50-dd23-4448-bddb-ce2d70c9ac4e', '2ebf7703-182f-4a01-823d-b961a46f5b4d', '8b09adcf-259b-4445-b332-4718995273ba', '2fc24e8b-ed86-4ecb-858b-66a99384c36d'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:22 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:22 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:22 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.428s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:22 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Deleted volume successfully. Jul 16 11:08:22 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8e8b6a15-97c9-4a57-907c-bc6b35afb49d tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-f7346f49-87ed-45f8-b04d-315d834514da-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "cinder-d4da740c-908d-4701-8ac0-556785b62bf6-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-d4da740c-908d-4701-8ac0-556785b62bf6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "cinder-quobyte-d4da740c-908d-4701-8ac0-556785b62bf6" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-quobyte-d4da740c-908d-4701-8ac0-556785b62bf6" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:23 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf0f030-c99b-4344-a306-3bf3d50db361]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:23 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-20409972-fe54-447f-a3d6-0253083e0f6c req-45410243-a2f8-4ff0-8c7f-52e5759f1073 tempest-AttachVolumeTestJSON-792425831 None] Terminate volume connection completed successfully. Jul 16 11:08:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-20409972-fe54-447f-a3d6-0253083e0f6c req-45410243-a2f8-4ff0-8c7f-52e5759f1073 tempest-AttachVolumeTestJSON-792425831 None] Deleting attachment efa3443c-f895-4283-9e9c-2975ddcbbdcb. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:08:23 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6 Jul 16 11:08:23 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:23 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6" returned: 0 in 0.513s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:23 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6 Jul 16 11:08:23 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:24 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d4da740c-908d-4701-8ac0-556785b62bf6" returned: 0 in 0.560s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-quobyte-d4da740c-908d-4701-8ac0-556785b62bf6" released by "delete_volume" :: held 1.170s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:24 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Created reservations ['ff10f08b-74fa-4ab7-a495-fb2c8235aa3a', 'a415127b-cd3b-4244-b060-964bb44745a4', 'cfe7641f-a15e-4b3a-9a5b-d02e25e00e2b', '32c9e470-6a6b-4e41-b3a4-f0df705238da'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:24 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:24 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:24 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.469s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:24 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:25 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Deleted volume successfully. Jul 16 11:08:25 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-82b2591e-76e0-455f-a648-cc95f01078c6 req-4a40f5b1-6f94-45bb-9f56-459ee70a750d tempest-AttachVolumeTestJSON-792425831 None] Terminate volume connection completed successfully. Jul 16 11:08:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-82b2591e-76e0-455f-a648-cc95f01078c6 req-4a40f5b1-6f94-45bb-9f56-459ee70a750d tempest-AttachVolumeTestJSON-792425831 None] Deleting attachment 4c389b36-a91e-47a4-9835-cf3af2e34d3c. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:08:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-90c1e06f-7a36-4c70-bbd6-5311781f0b50 tempest-CreateVolumesFromImageTest-627994304 None] Lock "cinder-d4da740c-908d-4701-8ac0-556785b62bf6-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "cinder-89afae3f-44db-4d9b-b73b-9b77521aac38-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-89afae3f-44db-4d9b-b73b-9b77521aac38-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "cinder-quobyte-89afae3f-44db-4d9b-b73b-9b77521aac38" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-quobyte-89afae3f-44db-4d9b-b73b-9b77521aac38" acquired by "delete_volume" :: waited 0.048s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:32 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[47369f5a-1e74-44e2-a187-f6737f3e388c]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:32 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38 Jul 16 11:08:32 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:33 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38" returned: 0 in 0.626s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:33 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38 Jul 16 11:08:33 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:33 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89afae3f-44db-4d9b-b73b-9b77521aac38" returned: 0 in 0.272s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-quobyte-89afae3f-44db-4d9b-b73b-9b77521aac38" released by "delete_volume" :: held 0.977s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Created reservations ['d9c124c2-e7bf-4b55-9a8a-59a03761d754', '5fc21841-4d9b-4d9c-a696-4996aa122903', '732ce05b-b288-4a58-84a7-0ae605912e07', 'e58e26bf-0aea-4f85-87f1-dcbe83f28cdc'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:33 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:33 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Flow 'volume_create_manager' (24b4bdfc-6f40-479d-874c-4545b2f21ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7b46d4-50c0-448a-89b9-c272af8b1db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7b46d4-50c0-448a-89b9-c272af8b1db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-166145884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ffd4bf-139d-46ba-9442-6a5400b5790c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4941ccb11ab04ccbaee0b8b6e8f21c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:34Z,use_quota=True,user_id='c428d4edf6bd48d6af20a1340230c6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224b02cb-a0ac-4f62-9b7a-7ff86eef7881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224b02cb-a0ac-4f62-9b7a-7ff86eef7881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c650bf91-2fd1-4bff-b4cd-6b55e7f0d3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c650bf91-2fd1-4bff-b4cd-6b55e7f0d3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ffd4bf-139d-46ba-9442-6a5400b5790c', 'volume_name': 'volume-94ffd4bf-139d-46ba-9442-6a5400b5790c', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:34 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c19911-e98f-4000-a307-cffa753d07ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c19911-e98f-4000-a307-cffa753d07ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5a847e-a5c1-4ec4-8a87-29381b8fbce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:34 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Volume 94ffd4bf-139d-46ba-9442-6a5400b5790c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ffd4bf-139d-46ba-9442-6a5400b5790c', 'volume_size': 1} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-166145884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ffd4bf-139d-46ba-9442-6a5400b5790c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4941ccb11ab04ccbaee0b8b6e8f21c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:34Z,use_quota=True,user_id='c428d4edf6bd48d6af20a1340230c6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Creating volume 94ffd4bf-139d-46ba-9442-6a5400b5790c {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:34 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.316s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Deleted volume successfully. Jul 16 11:08:34 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c 1073741824 Jul 16 11:08:34 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-12e78838-37e3-4679-ba4d-8899e77fb680 tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-89afae3f-44db-4d9b-b73b-9b77521aac38-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:34 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c 1073741824" returned: 0 in 0.573s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:34 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:34 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:34 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c Jul 16 11:08:34 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "cinder-2abadfb1-d127-400d-80fc-54f197afb556-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-2abadfb1-d127-400d-80fc-54f197afb556-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "cinder-quobyte-2abadfb1-d127-400d-80fc-54f197afb556" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-quobyte-2abadfb1-d127-400d-80fc-54f197afb556" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:34 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.320s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[772cf4be-84de-4246-9ad6-fc0df2e1febb]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:35 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:35 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556 Jul 16 11:08:35 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c" returned: 0 in 0.454s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5a847e-a5c1-4ec4-8a87-29381b8fbce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ffd4bf-139d-46ba-9442-6a5400b5790c', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a573604-1605-4587-9016-2a3d04de8bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:35 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Volume volume-94ffd4bf-139d-46ba-9442-6a5400b5790c (94ffd4bf-139d-46ba-9442-6a5400b5790c): created successfully Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a573604-1605-4587-9016-2a3d04de8bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Flow 'volume_create_manager' (24b4bdfc-6f40-479d-874c-4545b2f21ccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b6974dd2-0c22-45c0-81bd-80bec9c4cb9c tempest-VolumeQuotasAdminTestJSON-760586146 None] Created volume successfully. Jul 16 11:08:35 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556" returned: 0 in 0.505s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:35 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556 Jul 16 11:08:35 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:35 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2abadfb1-d127-400d-80fc-54f197afb556" returned: 0 in 0.268s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-quobyte-2abadfb1-d127-400d-80fc-54f197afb556" released by "delete_volume" :: held 0.837s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Created reservations ['02625a2b-501a-4244-b306-5cca794776e7', 'de38098d-87d2-4716-a03b-2c55e3325f2c', '8931fc1a-f01f-49e4-b4ac-5606720c39f4', '0ae47c0f-3114-4054-8fb6-8474f77a4276'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:35 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:35 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Acquiring lock "cinder-94ffd4bf-139d-46ba-9442-6a5400b5790c-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "cinder-94ffd4bf-139d-46ba-9442-6a5400b5790c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:36 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "cinder-34aa9714-96f7-483c-a9de-008c77f09c51-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.280s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:36 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Deleted volume successfully. Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Acquiring lock "cinder-quobyte-94ffd4bf-139d-46ba-9442-6a5400b5790c" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-34aa9714-96f7-483c-a9de-008c77f09c51-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "cinder-quobyte-94ffd4bf-139d-46ba-9442-6a5400b5790c" acquired by "delete_volume" :: waited 0.040s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-45d7000d-9616-41c3-adf3-4bab9612b26e tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-2abadfb1-d127-400d-80fc-54f197afb556-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[539caead-771d-4dbc-80d5-84aa0ff5168a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "cinder-quobyte-34aa9714-96f7-483c-a9de-008c77f09c51" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-quobyte-34aa9714-96f7-483c-a9de-008c77f09c51" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f9a156-d446-407a-bd54-5abe740e3695]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:36 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c Jul 16 11:08:36 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:36 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51 Jul 16 11:08:36 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:36 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c" returned: 0 in 0.374s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:36 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c Jul 16 11:08:36 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:36 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51" returned: 0 in 0.381s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:36 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51 Jul 16 11:08:36 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:36 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-94ffd4bf-139d-46ba-9442-6a5400b5790c" returned: 0 in 0.280s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "cinder-quobyte-94ffd4bf-139d-46ba-9442-6a5400b5790c" released by "delete_volume" :: held 0.730s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:37 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34aa9714-96f7-483c-a9de-008c77f09c51" returned: 0 in 0.265s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-quobyte-34aa9714-96f7-483c-a9de-008c77f09c51" released by "delete_volume" :: held 0.696s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Created reservations ['71c249fb-a617-443a-91bc-ebb856f1b721', '7904df43-eaa5-4cd9-8699-acf4124f43c8', 'c822c7a1-6e13-4458-9073-50697d33cb1f', 'e2ff2bc4-59c7-4a12-a573-029b3078f383'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Created reservations ['ef1d562f-88ef-4b54-9945-c36b8b64a231', 'cb64b247-4309-4dd3-a784-bf42e0bef2b0', 'aa0f70a5-74d0-443e-9eef-1c63e910fd91', 'e0265684-640c-4f14-b863-cedadc7944d9'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:37 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:37 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:37 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:37 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:37 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.423s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:37 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:37 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Deleted volume successfully. Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.356s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:37 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Deleted volume successfully. Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-505335f5-c4c8-412d-a220-886e14861f89 tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "cinder-94ffd4bf-139d-46ba-9442-6a5400b5790c-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7d3eaa09-0119-4f4e-b803-ad03483811ea tempest-AttachVolumeTestJSON-792425831 None] Lock "cinder-34aa9714-96f7-483c-a9de-008c77f09c51-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Flow 'volume_create_manager' (e210b317-47f3-474e-bcfc-1358c0ae5888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750a0c95-0f30-4da7-9fe9-eb5d8707ac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750a0c95-0f30-4da7-9fe9-eb5d8707ac9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-288032018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c1edc4-0766-4662-baa0-edc47cbf450b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4941ccb11ab04ccbaee0b8b6e8f21c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:38Z,use_quota=True,user_id='c428d4edf6bd48d6af20a1340230c6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea870d3-8d65-4145-aed9-82376bc57fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea870d3-8d65-4145-aed9-82376bc57fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c0ce24-cdf7-4253-a294-0c9f6f811f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c0ce24-cdf7-4253-a294-0c9f6f811f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c1edc4-0766-4662-baa0-edc47cbf450b', 'volume_name': 'volume-43c1edc4-0766-4662-baa0-edc47cbf450b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9dd6a7-0441-454e-a0f4-592293019513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9dd6a7-0441-454e-a0f4-592293019513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d466ff-7ef9-4912-b9a2-3c30c3d86d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Volume 43c1edc4-0766-4662-baa0-edc47cbf450b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c1edc4-0766-4662-baa0-edc47cbf450b', 'volume_size': 1} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-288032018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c1edc4-0766-4662-baa0-edc47cbf450b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4941ccb11ab04ccbaee0b8b6e8f21c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:38Z,use_quota=True,user_id='c428d4edf6bd48d6af20a1340230c6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Creating volume 43c1edc4-0766-4662-baa0-edc47cbf450b {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:38 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:38 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b 1073741824 Jul 16 11:08:38 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:38 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b 1073741824" returned: 0 in 0.518s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:38 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b Jul 16 11:08:38 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:38 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d466ff-7ef9-4912-b9a2-3c30c3d86d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c1edc4-0766-4662-baa0-edc47cbf450b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44821c4-a1ce-4a33-9bde-1792833ee45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Volume volume-43c1edc4-0766-4662-baa0-edc47cbf450b (43c1edc4-0766-4662-baa0-edc47cbf450b): created successfully Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44821c4-a1ce-4a33-9bde-1792833ee45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Flow 'volume_create_manager' (e210b317-47f3-474e-bcfc-1358c0ae5888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-dda9fd98-5047-48f7-ab41-4d07a8620169 tempest-VolumeQuotasAdminTestJSON-760586146 None] Created volume successfully. Jul 16 11:08:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-467bd3a0-133c-42c8-b6ef-a800176bf40a tempest-VolumeQuotasAdminTestJSON-830106253 None] Transfer volume completed successfully. Jul 16 11:08:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Acquiring lock "cinder-43c1edc4-0766-4662-baa0-edc47cbf450b-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Lock "cinder-43c1edc4-0766-4662-baa0-edc47cbf450b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Acquiring lock "cinder-quobyte-43c1edc4-0766-4662-baa0-edc47cbf450b" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Lock "cinder-quobyte-43c1edc4-0766-4662-baa0-edc47cbf450b" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:41 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b29cb9e-1a5a-4a87-91ea-a41746f92642]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:41 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b Jul 16 11:08:41 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:42 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b" returned: 0 in 0.403s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:42 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b Jul 16 11:08:42 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:42 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-43c1edc4-0766-4662-baa0-edc47cbf450b" returned: 0 in 0.279s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Lock "cinder-quobyte-43c1edc4-0766-4662-baa0-edc47cbf450b" released by "delete_volume" :: held 0.733s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Created reservations ['ff4221fb-1e6b-4d18-a771-efe8f0180a60', 'b3c2e04c-aabe-4cde-9463-2f3a46f5a24f', 'c8037011-c7b9-4ba9-8b8a-e2884323d9f7', '50e4bd4f-ac5c-4fcb-bdbb-e02387901278'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:42 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:42 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:42 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.413s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:42 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Deleted volume successfully. Jul 16 11:08:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6add9ab-c623-4a28-940a-02c3141e1d08 tempest-VolumeQuotasAdminTestJSON-1775609853 None] Lock "cinder-43c1edc4-0766-4662-baa0-edc47cbf450b-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Flow 'volume_create_manager' (cfcb0652-d163-43ad-b841-24752cec3a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8b196e-f52d-4df1-b234-495158674fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8b196e-f52d-4df1-b234-495158674fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-316861362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d719a07-78bc-4f69-82a5-c52c7f805eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cc0feaab5f4524bcdd1133d2677a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:46Z,use_quota=True,user_id='dfd2cd4c42674ee089b7fd69059c0e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7701723f-84d4-43c5-81e5-9bb91e4e4242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7701723f-84d4-43c5-81e5-9bb91e4e4242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec1e81c-e502-40b4-a506-5e68a7877124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec1e81c-e502-40b4-a506-5e68a7877124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d719a07-78bc-4f69-82a5-c52c7f805eba', 'volume_name': 'volume-8d719a07-78bc-4f69-82a5-c52c7f805eba', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cc87ad-c09b-4bef-82eb-0d6977600b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21cc87ad-c09b-4bef-82eb-0d6977600b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e1648f-8e2c-414c-b527-2267e45de1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:45 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Volume 8d719a07-78bc-4f69-82a5-c52c7f805eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d719a07-78bc-4f69-82a5-c52c7f805eba', 'volume_size': 1} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-316861362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d719a07-78bc-4f69-82a5-c52c7f805eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cc0feaab5f4524bcdd1133d2677a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:46Z,use_quota=True,user_id='dfd2cd4c42674ee089b7fd69059c0e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Creating volume 8d719a07-78bc-4f69-82a5-c52c7f805eba {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:45 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:45 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba 1073741824 Jul 16 11:08:45 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:46 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba 1073741824" returned: 0 in 0.482s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:46 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba Jul 16 11:08:46 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:46 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba" returned: 0 in 0.279s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e1648f-8e2c-414c-b527-2267e45de1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d719a07-78bc-4f69-82a5-c52c7f805eba', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc08cd4-028c-4b17-9599-6ce038964b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:46 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Volume volume-8d719a07-78bc-4f69-82a5-c52c7f805eba (8d719a07-78bc-4f69-82a5-c52c7f805eba): created successfully Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc08cd4-028c-4b17-9599-6ce038964b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Flow 'volume_create_manager' (cfcb0652-d163-43ad-b841-24752cec3a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:46 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-59a2d2ec-ce97-48ec-a848-520ea5422f70 req-37813eed-3b4b-4a07-a007-a4269ce93394 tempest-VolumesSnapshotsTestJSON-1302575706 None] Created volume successfully. Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] Creating offline snapshot b4d91795-4e0d-4dd9-8b98-fbe78d731c4e of volume 8d719a07-78bc-4f69-82a5-c52c7f805eba {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da5a2a-4116-48c6-9264-3538c4b8a741]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:47 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba Jul 16 11:08:47 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:47 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba" returned: 0 in 0.537s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:47 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e 1G Jul 16 11:08:47 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:47 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e 1G" returned: 0 in 0.437s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d719a07-78bc-4f69-82a5-c52c7f805eba -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:47 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d719a07-78bc-4f69-82a5-c52c7f805eba -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e Jul 16 11:08:47 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:48 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d719a07-78bc-4f69-82a5-c52c7f805eba -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e" returned: 0 in 0.318s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:48 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e is being set with open permissions: ugo+rw Jul 16 11:08:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:48 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e Jul 16 11:08:48 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:48 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e" returned: 0 in 0.262s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:48 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.info Jul 16 11:08:48 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:48 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.info" returned: 0 in 0.278s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:48 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.info is being set with open permissions: ugo+rw Jul 16 11:08:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:48 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.info Jul 16 11:08:48 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:49 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.info" returned: 0 in 0.265s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:49 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-5b542faa-699a-499b-999e-4f0cb4662b54 req-cb88436b-eedf-4355-b4c9-9faf7c3e29cf tempest-VolumesSnapshotsTestJSON-1302575706 None] Create snapshot completed successfully Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Acquiring lock "cinder-b4d91795-4e0d-4dd9-8b98-fbe78d731c4e-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "cinder-b4d91795-4e0d-4dd9-8b98-fbe78d731c4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Acquiring lock "cinder-quobyte-8d719a07-78bc-4f69-82a5-c52c7f805eba" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "cinder-quobyte-8d719a07-78bc-4f69-82a5-c52c7f805eba" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Acquiring lock "cinder-quobyte-b4d91795-4e0d-4dd9-8b98-fbe78d731c4e" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "cinder-quobyte-b4d91795-4e0d-4dd9-8b98-fbe78d731c4e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Deleting offline snapshot b4d91795-4e0d-4dd9-8b98-fbe78d731c4e of volume 8d719a07-78bc-4f69-82a5-c52c7f805eba {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] snapshot_file for this snap is: volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f71331-5481-4271-ae7e-4149bbe5e5aa]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:50 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e Jul 16 11:08:50 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:50 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e" returned: 0 in 0.405s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d719a07-78bc-4f69-82a5-c52c7f805eba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[41745359-4c78-4ba0-8bc8-7542fd035985]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:50 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba Jul 16 11:08:50 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:50 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba" returned: 0 in 0.450s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:50 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e Jul 16 11:08:50 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Flow 'volume_create_manager' (3f08ea3f-d29e-4c1f-a56a-0576b106241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608d8448-1ee9-4356-933d-379961115ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608d8448-1ee9-4356-933d-379961115ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-381854652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d4959d-8b7f-4f18-9447-6f95d5edac3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71f9a27b79b4acea4a1538882208b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:51Z,use_quota=True,user_id='9d6e71b8c8b845c8844e4433c6d2fbfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad376485-6c41-4f26-a00b-7ad63b06203d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad376485-6c41-4f26-a00b-7ad63b06203d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f09b813-4e3a-4d15-9494-8eef5ba7c56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f09b813-4e3a-4d15-9494-8eef5ba7c56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d4959d-8b7f-4f18-9447-6f95d5edac3f', 'volume_name': 'volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c8bac4-9ffc-4ae8-8439-8f9f92211a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c8bac4-9ffc-4ae8-8439-8f9f92211a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6e7958-8d9d-45fe-83cf-8ddb5a0053b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:50 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Volume f4d4959d-8b7f-4f18-9447-6f95d5edac3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f', 'volume_size': 1} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-381854652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d4959d-8b7f-4f18-9447-6f95d5edac3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c71f9a27b79b4acea4a1538882208b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:51Z,use_quota=True,user_id='9d6e71b8c8b845c8844e4433c6d2fbfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Creating volume f4d4959d-8b7f-4f18-9447-6f95d5edac3f {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:50 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:51 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f 1073741824 Jul 16 11:08:51 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:51 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e" returned: 0 in 0.353s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:51 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e Jul 16 11:08:51 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:51 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba.b4d91795-4e0d-4dd9-8b98-fbe78d731c4e" returned: 0 in 0.281s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:51 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f 1073741824" returned: 0 in 0.450s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "cinder-quobyte-b4d91795-4e0d-4dd9-8b98-fbe78d731c4e" released by "_delete_snapshot" :: held 1.596s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "cinder-quobyte-8d719a07-78bc-4f69-82a5-c52c7f805eba" released by "delete_snapshot" :: held 1.630s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:51 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f Jul 16 11:08:51 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG cinder.quota [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Created reservations ['73bd3cc3-6c1b-45ac-a2b1-d18645e773c7', '3253703b-a63e-4a76-b809-cdf2c7302283', '057bba0d-8115-484a-b26b-91245ab1ae80', 'e616b0db-d790-4428-831c-a93c8c4a316f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:51 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Delete snapshot completed successfully. Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d9182db4-d595-457d-a76b-1eadea853cea req-583f63f9-fa6f-464e-944b-d844e891d905 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "cinder-b4d91795-4e0d-4dd9-8b98-fbe78d731c4e-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:51 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f" returned: 0 in 0.268s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6e7958-8d9d-45fe-83cf-8ddb5a0053b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26748e19-1523-4d0c-98a8-4343f121e4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:51 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Volume volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f (f4d4959d-8b7f-4f18-9447-6f95d5edac3f): created successfully Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26748e19-1523-4d0c-98a8-4343f121e4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Flow 'volume_create_manager' (3f08ea3f-d29e-4c1f-a56a-0576b106241f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:51 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e1512fd6-1b1a-46f4-b48d-495340f21314 tempest-VolumesServicesTestJSON-30301654 None] Created volume successfully. Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Acquiring lock "cinder-8d719a07-78bc-4f69-82a5-c52c7f805eba-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "cinder-8d719a07-78bc-4f69-82a5-c52c7f805eba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Acquiring lock "cinder-quobyte-8d719a07-78bc-4f69-82a5-c52c7f805eba" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "cinder-quobyte-8d719a07-78bc-4f69-82a5-c52c7f805eba" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c30bc87-a569-47b8-89fa-b7b268c0d7fe]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:52 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba Jul 16 11:08:52 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:52 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba" returned: 0 in 0.364s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:52 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba Jul 16 11:08:52 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:52 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8d719a07-78bc-4f69-82a5-c52c7f805eba" returned: 0 in 0.257s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "cinder-quobyte-8d719a07-78bc-4f69-82a5-c52c7f805eba" released by "delete_volume" :: held 0.684s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG cinder.quota [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Created reservations ['e2001ef3-e32e-4737-bf60-4464b3e63851', 'a773fe20-699b-4c1e-b25e-a3064f71e66b', 'fe8031a7-7592-4dad-a255-514afaacaeea', 'f86a176f-005b-46b5-bc5a-8d89478a02cf'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:53 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:53 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Acquiring lock "cinder-f4d4959d-8b7f-4f18-9447-6f95d5edac3f-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Lock "cinder-f4d4959d-8b7f-4f18-9447-6f95d5edac3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Acquiring lock "cinder-quobyte-f4d4959d-8b7f-4f18-9447-6f95d5edac3f" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Lock "cinder-quobyte-f4d4959d-8b7f-4f18-9447-6f95d5edac3f" acquired by "delete_volume" :: waited 0.035s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:53 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2551ead-bdcb-4118-bfbf-626ce9e222bd]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:53 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.345s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:53 devstack cinder-volume[87345]: DEBUG cinder.manager [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:53 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Deleted volume successfully. Jul 16 11:08:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-c0412ed9-3c26-49f6-93fa-7aa086a404ef req-e00f64d0-fc3c-4186-8144-50304a2d26a1 tempest-VolumesSnapshotsTestJSON-1302575706 None] Lock "cinder-8d719a07-78bc-4f69-82a5-c52c7f805eba-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:53 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f Jul 16 11:08:53 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:53 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f" returned: 0 in 0.438s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:53 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f Jul 16 11:08:53 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:54 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f4d4959d-8b7f-4f18-9447-6f95d5edac3f" returned: 0 in 0.263s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Lock "cinder-quobyte-f4d4959d-8b7f-4f18-9447-6f95d5edac3f" released by "delete_volume" :: held 0.759s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Created reservations ['783593ea-5c7a-4237-9b31-5bdd0fe76fff', 'd7838539-e290-44b5-9c4a-5fe85ceb700e', '7513376e-8fe3-4ecd-8be5-046f12a5e37e', '60bb09e2-bfa6-4bbf-aeac-3c787d797717'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:54 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:54 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:54 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.343s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:08:54 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Deleted volume successfully. Jul 16 11:08:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114d2fe0-9b3a-4fc9-bd96-4b3151dd4dbd tempest-VolumesServicesTestJSON-30301654 None] Lock "cinder-f4d4959d-8b7f-4f18-9447-6f95d5edac3f-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Flow 'volume_create_manager' (d469c7c1-5482-4531-8562-1a0e68312d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd459e0-82d4-4ac6-8af4-13a5745bf7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd459e0-82d4-4ac6-8af4-13a5745bf7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1575798523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759174ba-a20a-43cf-ba60-8e200afc436e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='131e23b374754098b6642d1f65cc20d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:57Z,use_quota=True,user_id='f63d5edba829443893af398c9f99f674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eca0c3d-8009-4705-97c2-ceb429467d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eca0c3d-8009-4705-97c2-ceb429467d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d33cbf-c8cc-4a42-8096-cd994a3a710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d33cbf-c8cc-4a42-8096-cd994a3a710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759174ba-a20a-43cf-ba60-8e200afc436e', 'volume_name': 'volume-759174ba-a20a-43cf-ba60-8e200afc436e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b844448a-e5bd-43ab-9f9d-70cee87dc3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b844448a-e5bd-43ab-9f9d-70cee87dc3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a78efb-d424-4b93-82e3-6e143f33dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:57 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Volume 759174ba-a20a-43cf-ba60-8e200afc436e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759174ba-a20a-43cf-ba60-8e200afc436e', 'volume_size': 1} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1575798523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759174ba-a20a-43cf-ba60-8e200afc436e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='131e23b374754098b6642d1f65cc20d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:08:57Z,use_quota=True,user_id='f63d5edba829443893af398c9f99f674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Creating volume 759174ba-a20a-43cf-ba60-8e200afc436e {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:08:57 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:08:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:57 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e 1073741824 Jul 16 11:08:57 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:58 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e 1073741824" returned: 0 in 0.424s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:58 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e Jul 16 11:08:58 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:58 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e" returned: 0 in 0.259s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:08:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:58 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a78efb-d424-4b93-82e3-6e143f33dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759174ba-a20a-43cf-ba60-8e200afc436e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:58 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b5d323-f4dc-458b-8f8a-862e4d1b2fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:08:58 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Volume volume-759174ba-a20a-43cf-ba60-8e200afc436e (759174ba-a20a-43cf-ba60-8e200afc436e): created successfully Jul 16 11:08:58 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b5d323-f4dc-458b-8f8a-862e4d1b2fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:08:58 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Flow 'volume_create_manager' (d469c7c1-5482-4531-8562-1a0e68312d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:08:58 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-4268f0e1-d1b2-473c-b3ab-c49c649af3cf req-ba4e4d16-5f0d-477c-a760-49df68e3cebc tempest-VolumesGetTestJSON-472310380 None] Created volume successfully. Jul 16 11:08:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Acquiring lock "cinder-759174ba-a20a-43cf-ba60-8e200afc436e-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Lock "cinder-759174ba-a20a-43cf-ba60-8e200afc436e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Acquiring lock "cinder-quobyte-759174ba-a20a-43cf-ba60-8e200afc436e" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Lock "cinder-quobyte-759174ba-a20a-43cf-ba60-8e200afc436e" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8917753c-ac57-4add-9bd4-7dbdc8be1bbe]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:59 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e Jul 16 11:08:59 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:59 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e" returned: 0 in 0.374s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:59 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e Jul 16 11:08:59 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:08:59 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-759174ba-a20a-43cf-ba60-8e200afc436e" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Lock "cinder-quobyte-759174ba-a20a-43cf-ba60-8e200afc436e" released by "delete_volume" :: held 0.666s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=106,cinder:UPDATE=149,cinder:INSERT=35,cinder:DELETE=9 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=132,cinder:UPDATE=145,cinder:DELETE=17,cinder:INSERT=31 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG cinder.quota [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Created reservations ['4ab4c4c3-dcba-4d63-9664-acc94233d5a0', 'b2b3d2a6-4425-4f8d-9207-f3c38d3e078e', 'a22b7955-0906-46ed-9954-7f3dcd0bba60', '5d78d0df-5de5-4e69-a49c-d3cece2b1b13'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:08:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:08:59 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:08:59 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:00 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.272s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:00 devstack cinder-volume[87345]: DEBUG cinder.manager [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:00 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Deleted volume successfully. Jul 16 11:09:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-f6ad1e1f-f493-46e4-a478-2d1455fec6c7 req-76898595-fe44-4315-a414-695af09f296f tempest-VolumesGetTestJSON-472310380 None] Lock "cinder-759174ba-a20a-43cf-ba60-8e200afc436e-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:04 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-982e8299-5b47-47ad-b42f-93ef1db42ab2 tempest-GroupSnapshotsTest-1630222017 None] Group tempest-GroupSnapshotsTest-Group-900087568: creating Jul 16 11:09:04 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-982e8299-5b47-47ad-b42f-93ef1db42ab2 tempest-GroupSnapshotsTest-1630222017 None] Group tempest-GroupSnapshotsTest-Group-900087568: created successfully Jul 16 11:09:04 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-982e8299-5b47-47ad-b42f-93ef1db42ab2 tempest-GroupSnapshotsTest-1630222017 None] Create group completed successfully. Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Flow 'volume_create_manager' (1af93c54-c3d9-4b55-bf81-b67f99263d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e06085-e1df-47f7-9d7c-724f831c939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e06085-e1df-47f7-9d7c-724f831c939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-931992585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ae6f069f-fdb6-4861-9054-883e9b85e6b3,host='devstack@QuobyteHD#QuobyteHD',id=0bc54b93-e74e-436d-a337-432c84d709c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfe72a767674079a2e017ef7ecf1dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:06Z,use_quota=True,user_id='b7acbf078e154649b73399b21e2bbf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbbafd90-3601-4634-bd6b-8411b9a081ba),volume_type_id=cbbafd90-3601-4634-bd6b-8411b9a081ba)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005e1897-9f3e-48a5-980c-c1f987ba6959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005e1897-9f3e-48a5-980c-c1f987ba6959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58aea9ae-d0b5-48e4-b843-3f6c569d905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58aea9ae-d0b5-48e4-b843-3f6c569d905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc54b93-e74e-436d-a337-432c84d709c0', 'volume_name': 'volume-0bc54b93-e74e-436d-a337-432c84d709c0', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ce2ed8-e9ff-4f44-922d-ed9bc673f308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ce2ed8-e9ff-4f44-922d-ed9bc673f308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41b63cf-1a0f-453e-be0b-ae6c502f0d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:06 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Volume 0bc54b93-e74e-436d-a337-432c84d709c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc54b93-e74e-436d-a337-432c84d709c0', 'volume_size': 1} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ae6f069f-fdb6-4861-9054-883e9b85e6b3,created_at=2026-07-16T09:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-931992585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ae6f069f-fdb6-4861-9054-883e9b85e6b3,host='devstack@QuobyteHD#QuobyteHD',id=0bc54b93-e74e-436d-a337-432c84d709c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfe72a767674079a2e017ef7ecf1dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:06Z,use_quota=True,user_id='b7acbf078e154649b73399b21e2bbf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbbafd90-3601-4634-bd6b-8411b9a081ba),volume_type_id=cbbafd90-3601-4634-bd6b-8411b9a081ba)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Creating volume 0bc54b93-e74e-436d-a337-432c84d709c0 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:06 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:06 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 1073741824 Jul 16 11:09:06 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:07 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 1073741824" returned: 0 in 0.527s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:07 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 Jul 16 11:09:07 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:07 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-bc0b2489-b11f-4ce5-a130-ddcd2f287738 req-a8c0d3f5-85a4-4c39-881a-e040c26d57d8 tempest-TestMinimumBasicScenario-969644819 None] Terminate volume connection completed successfully. Jul 16 11:09:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-bc0b2489-b11f-4ce5-a130-ddcd2f287738 req-a8c0d3f5-85a4-4c39-881a-e040c26d57d8 tempest-TestMinimumBasicScenario-969644819 None] Deleting attachment 6b17a9ac-acd9-4466-b578-c8a76ee850a9. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:09:07 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0" returned: 0 in 0.308s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41b63cf-1a0f-453e-be0b-ae6c502f0d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc54b93-e74e-436d-a337-432c84d709c0', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfdd3d1-6b8c-44c9-bf43-fa13acb49349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Volume volume-0bc54b93-e74e-436d-a337-432c84d709c0 (0bc54b93-e74e-436d-a337-432c84d709c0): created successfully Jul 16 11:09:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfdd3d1-6b8c-44c9-bf43-fa13acb49349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Flow 'volume_create_manager' (1af93c54-c3d9-4b55-bf81-b67f99263d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:07 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-3cf0d6ce-a658-48ba-8460-3c198d6467cb tempest-GroupSnapshotsTest-1630222017 None] Created volume successfully. Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Acquiring lock "cinder-e1e9cc78-5b91-4346-a110-e382d74a6d22-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Lock "cinder-e1e9cc78-5b91-4346-a110-e382d74a6d22-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Acquiring lock "cinder-quobyte-e1e9cc78-5b91-4346-a110-e382d74a6d22" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Lock "cinder-quobyte-e1e9cc78-5b91-4346-a110-e382d74a6d22" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d86c08-7131-4e14-b687-23add7a6adf9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:08 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22 Jul 16 11:09:08 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:08 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22" returned: 0 in 0.374s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:08 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22 Jul 16 11:09:08 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:08 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e1e9cc78-5b91-4346-a110-e382d74a6d22" returned: 0 in 0.257s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Lock "cinder-quobyte-e1e9cc78-5b91-4346-a110-e382d74a6d22" released by "delete_volume" :: held 0.675s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Created reservations ['cff5edfe-584f-43cb-8937-cba85694f4a7', 'fdc4a18f-6efa-44a3-a8a9-56ea714fe625', '1943fa24-16df-4f6a-8991-cdbd32d7ecd9', '323950b3-7702-4dba-a039-63a9fa6f05d4'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:08 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:08 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] GroupSnapshot ae1ed175-3983-46e9-9a35-6de36b48dfce: creating. Jul 16 11:09:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] Group snapshot ae1ed175-3983-46e9-9a35-6de36b48dfce: creating. {{(pid=87345) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 11:09:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] Creating offline snapshot 832beee2-500a-4f90-abd9-eb6c367c9f77 of volume 0bc54b93-e74e-436d-a337-432c84d709c0 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:09:09 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6d9553-d7ce-4f15-9865-bbd283bff995]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:09 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.294s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:09 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Deleted volume successfully. Jul 16 11:09:09 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 Jul 16 11:09:09 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4111bf5f-11a6-414c-bd42-ed3c7154c6a4 tempest-TestMinimumBasicScenario-969644819 None] Lock "cinder-e1e9cc78-5b91-4346-a110-e382d74a6d22-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:09 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0" returned: 0 in 0.469s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:09 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 1G Jul 16 11:09:09 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:10 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 1G" returned: 0 in 0.658s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc54b93-e74e-436d-a337-432c84d709c0 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:10 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc54b93-e74e-436d-a337-432c84d709c0 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 Jul 16 11:09:10 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:10 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc54b93-e74e-436d-a337-432c84d709c0 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77" returned: 0 in 0.432s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:10 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:09:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:10 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 Jul 16 11:09:10 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:11 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77" returned: 0 in 0.378s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:11 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.info Jul 16 11:09:11 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:11 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.info" returned: 0 in 0.373s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:11 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:09:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:11 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.info Jul 16 11:09:11 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:11 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.info" returned: 0 in 0.263s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.676s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:11 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8416fb72-5675-401d-aed5-e30e539bb4f9 tempest-GroupSnapshotsTest-1630222017 None] group_snapshot ae1ed175-3983-46e9-9a35-6de36b48dfce: created successfully Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Flow 'volume_create_manager' (722af380-acf6-434f-89cc-a702545168ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4332ee36-37d1-4640-a8a1-74a663547eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4332ee36-37d1-4640-a8a1-74a663547eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-302091342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5e1249-918c-4782-a1d5-75027a7ddb80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e6d90098374405b09a612cbc4f2330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:12Z,use_quota=True,user_id='7cdb80d5fb244e2990a0e3c2e38cfd36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba614ac-7052-44e9-a04f-1473126a4cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba614ac-7052-44e9-a04f-1473126a4cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (557da1d1-de0e-4588-b9bf-e6879cfc512e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (557da1d1-de0e-4588-b9bf-e6879cfc512e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb5e1249-918c-4782-a1d5-75027a7ddb80', 'volume_name': 'volume-cb5e1249-918c-4782-a1d5-75027a7ddb80', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bb9de5-c83c-4251-8fb4-77ea2df33f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bb9de5-c83c-4251-8fb4-77ea2df33f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8091bb-bf0f-425a-af64-bd6d981bf914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:12 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Volume cb5e1249-918c-4782-a1d5-75027a7ddb80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb5e1249-918c-4782-a1d5-75027a7ddb80', 'volume_size': 1} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-302091342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5e1249-918c-4782-a1d5-75027a7ddb80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e6d90098374405b09a612cbc4f2330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:12Z,use_quota=True,user_id='7cdb80d5fb244e2990a0e3c2e38cfd36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Creating volume cb5e1249-918c-4782-a1d5-75027a7ddb80 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:12 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:12 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 1073741824 Jul 16 11:09:12 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:12 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 1073741824" returned: 0 in 0.557s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:12 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 Jul 16 11:09:12 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:13 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80" returned: 0 in 0.299s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8091bb-bf0f-425a-af64-bd6d981bf914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5e1249-918c-4782-a1d5-75027a7ddb80', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d544d7-f622-4408-82a0-58521468a9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:13 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Volume volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 (cb5e1249-918c-4782-a1d5-75027a7ddb80): created successfully Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d544d7-f622-4408-82a0-58521468a9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Flow 'volume_create_manager' (722af380-acf6-434f-89cc-a702545168ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:13 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-76d6d8ab-d48f-426c-911b-95ce099d26ac tempest-VolumesDeleteCascade-1342360920 None] Created volume successfully. Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-832beee2-500a-4f90-abd9-eb6c367c9f77-d9c96543-d90e-4392-be1f-62765d0b90e7" by "_create_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-832beee2-500a-4f90-abd9-eb6c367c9f77-d9c96543-d90e-4392-be1f-62765d0b90e7" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Creating volume d9c96543-d90e-4392-be1f-62765d0b90e7 from snapshot 832beee2-500a-4f90-abd9-eb6c367c9f77 {{(pid=87345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-d9c96543-d90e-4392-be1f-62765d0b90e7" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-d9c96543-d90e-4392-be1f-62765d0b90e7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] snapshot: 832beee2-500a-4f90-abd9-eb6c367c9f77, volume: d9c96543-d90e-4392-be1f-62765d0b90e7, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f060a-7549-4f4e-97ce-f99f0f34287e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:13 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 Jul 16 11:09:13 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:13 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77" returned: 0 in 0.377s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bc54b93-e74e-436d-a337-432c84d709c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbc2d50-9031-4bf9-a25b-87a3a0ac67fc]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:13 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 Jul 16 11:09:13 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:14 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0" returned: 0 in 0.382s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:14 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7 not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:09:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:14 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7 Jul 16 11:09:14 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:19 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7" returned: 0 in 5.164s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:19 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1dcbbe-3d9c-412f-a060-eb9f87b799aa]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:19 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 Jul 16 11:09:19 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:19 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0" returned: 0 in 0.537s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:19 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0, size 1024.00 MB, duration 5.17 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:09:19 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Converted 1024.00 MB image at 198.25 MB/s Jul 16 11:09:19 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:09:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:19 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7 Jul 16 11:09:19 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:19 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-d9c96543-d90e-4392-be1f-62765d0b90e7" released by "_copy_volume_from_snapshot" :: held 6.801s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-832beee2-500a-4f90-abd9-eb6c367c9f77-d9c96543-d90e-4392-be1f-62765d0b90e7" released by "_create_volume_from_snapshot" :: held 6.848s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.872s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.696s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] Creating offline snapshot 4f55d389-dc1e-4e4e-8717-a4f016e76fde of volume cb5e1249-918c-4782-a1d5-75027a7ddb80 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b5f264-a332-4c0c-8c67-4e4df79feb88]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-50fd8101-fc98-4ce4-9b31-63fb3863efb4 tempest-GroupSnapshotsTest-1630222017 None] Create group from source-snapshot-ae1ed175-3983-46e9-9a35-6de36b48dfce completed successfully. Jul 16 11:09:20 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 Jul 16 11:09:20 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:20 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80" returned: 0 in 0.418s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:20 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde 1G Jul 16 11:09:20 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-d9c96543-d90e-4392-be1f-62765d0b90e7" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-d9c96543-d90e-4392-be1f-62765d0b90e7" acquired by "delete_volume" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[036fbdd0-72a5-471f-b030-72704e03e0ad]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:20 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7 Jul 16 11:09:20 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:20 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde 1G" returned: 0 in 0.499s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:21 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde Jul 16 11:09:21 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:21 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7" returned: 0 in 0.425s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:21 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7 Jul 16 11:09:21 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:21 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde" returned: 0 in 0.335s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:21 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde is being set with open permissions: ugo+rw Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:21 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde Jul 16 11:09:21 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:21 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d9c96543-d90e-4392-be1f-62765d0b90e7" returned: 0 in 0.354s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-d9c96543-d90e-4392-be1f-62765d0b90e7" released by "delete_volume" :: held 0.821s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:21 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['c5c6b350-3920-49db-9f7a-33be553d4607'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde" returned: 0 in 0.335s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:21 devstack cinder-volume[87345]: WARNING cinder.quota [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2017184894 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2017184894, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:09:21 devstack cinder-volume[87345]: WARNING cinder.quota [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2017184894 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2017184894, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:21 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.info Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['4a750d19-48b3-4780-be6c-9fa9178b733b', 'b7f27343-2ae9-4f32-9857-7bf8f9aa6a07', '7c59c3fc-6291-4bed-a3b0-b01d8949972e', 'b0c19b38-ec6c-4f56-b182-01abbd181ca1'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:21 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:21 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:21 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:21 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.info" returned: 0 in 0.277s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:21 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.info is being set with open permissions: ugo+rw Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:22 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.info Jul 16 11:09:22 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:22 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] group_snapshot ae1ed175-3983-46e9-9a35-6de36b48dfce: deleting Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] group_snapshot ae1ed175-3983-46e9-9a35-6de36b48dfce: deleting {{(pid=87345) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 11:09:22 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.305s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:22 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-3ff6af5e-403a-4866-9463-3ba9e1880ccb tempest-GroupSnapshotsTest-1630222017 None] Delete group completed successfully. Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-0bc54b93-e74e-436d-a337-432c84d709c0" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-0bc54b93-e74e-436d-a337-432c84d709c0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-832beee2-500a-4f90-abd9-eb6c367c9f77" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-832beee2-500a-4f90-abd9-eb6c367c9f77" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Deleting offline snapshot 832beee2-500a-4f90-abd9-eb6c367c9f77 of volume 0bc54b93-e74e-436d-a337-432c84d709c0 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] snapshot_file for this snap is: volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a333ec7-b6bc-45cd-835e-41c6c86a05c2]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:22 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.info" returned: 0 in 0.403s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:22 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d76996ad-9119-44e7-b44a-f29a92caff40 tempest-VolumesDeleteCascade-1342360920 None] Create snapshot completed successfully Jul 16 11:09:22 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 Jul 16 11:09:22 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:22 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77" returned: 0 in 0.488s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bc54b93-e74e-436d-a337-432c84d709c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccebba0-f8f4-4ab6-8925-69b2f56d8011]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:22 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 Jul 16 11:09:22 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] Creating offline snapshot 3530b77a-b6e6-43b5-9023-018908b57f0b of volume cb5e1249-918c-4782-a1d5-75027a7ddb80 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6224af10-4642-4d0c-b257-48bf524156ce]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:23 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde Jul 16 11:09:23 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:23 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0" returned: 0 in 0.426s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:23 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 Jul 16 11:09:23 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:23 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde" returned: 0 in 0.423s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb5e1249-918c-4782-a1d5-75027a7ddb80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:23 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b 1G Jul 16 11:09:23 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:23 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77" returned: 0 in 0.397s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:23 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77 Jul 16 11:09:23 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:23 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0.832beee2-500a-4f90-abd9-eb6c367c9f77" returned: 0 in 0.267s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:23 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b 1G" returned: 0 in 0.459s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-832beee2-500a-4f90-abd9-eb6c367c9f77" released by "_delete_snapshot" :: held 1.712s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-0bc54b93-e74e-436d-a337-432c84d709c0" released by "delete_snapshot" :: held 1.745s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:23 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b Jul 16 11:09:23 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:24 devstack cinder-volume[87345]: WARNING cinder.quota [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2017184894 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2017184894, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:09:24 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['c8ae1e0d-0e51-4703-853e-7d23c7d86942', '18fe6d8f-4878-4800-8ab6-00d5294413d2', 'fb233980-43e3-4c17-8ec9-f19ed7e8ac87', 'a8739a7e-62be-47a7-8bac-79f69dcc706a'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:24 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-97c11263-e16f-41e5-9b2b-7514c28c130a tempest-GroupSnapshotsTest-1630222017 None] group_snapshot ae1ed175-3983-46e9-9a35-6de36b48dfce: deleted successfully Jul 16 11:09:24 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b" returned: 0 in 0.353s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:24 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b is being set with open permissions: ugo+rw Jul 16 11:09:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:24 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b Jul 16 11:09:24 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:24 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b" returned: 0 in 0.278s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.618s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:24 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-adc62222-a95e-4272-a1aa-b0481ce518a5 tempest-VolumesDeleteCascade-1342360920 None] Create snapshot completed successfully Jul 16 11:09:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-0bc54b93-e74e-436d-a337-432c84d709c0" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-0bc54b93-e74e-436d-a337-432c84d709c0" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:24 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72f0059-a651-49b1-bad9-c2071f614ca5]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:24 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 Jul 16 11:09:24 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-cb5e1249-918c-4782-a1d5-75027a7ddb80-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-cb5e1249-918c-4782-a1d5-75027a7ddb80-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Performing cascade delete. {{(pid=87345) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-3530b77a-b6e6-43b5-9023-018908b57f0b-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-3530b77a-b6e6-43b5-9023-018908b57f0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:25 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0" returned: 0 in 0.432s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-quobyte-cb5e1249-918c-4782-a1d5-75027a7ddb80" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:25 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0 Jul 16 11:09:25 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-cb5e1249-918c-4782-a1d5-75027a7ddb80" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-quobyte-3530b77a-b6e6-43b5-9023-018908b57f0b" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-3530b77a-b6e6-43b5-9023-018908b57f0b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Deleting offline snapshot 3530b77a-b6e6-43b5-9023-018908b57f0b of volume cb5e1249-918c-4782-a1d5-75027a7ddb80 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] snapshot_file for this snap is: volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[83265e2e-7db0-48e2-b509-a449e479b32d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:25 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b Jul 16 11:09:25 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:25 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0bc54b93-e74e-436d-a337-432c84d709c0" returned: 0 in 0.281s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-0bc54b93-e74e-436d-a337-432c84d709c0" released by "delete_volume" :: held 0.792s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['7821d8ed-15a6-4d11-8757-343efbb234e9'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:25 devstack cinder-volume[87345]: WARNING cinder.db.api [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2017184894'] Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['1f244d5a-caf4-4bac-9652-1dcddbc9ed75', 'dbe63164-4dab-4fc6-a3ad-cf0f6d9235a9', 'dbcee3b7-cc47-45fb-b49b-a5134bd32dd3', '0c805711-118b-4de5-bfaf-c6a743a4776e'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:25 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b" returned: 0 in 0.445s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb5e1249-918c-4782-a1d5-75027a7ddb80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:09:25 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:25 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da63db9-326a-4e7a-9476-b24afb179eb6]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:26 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde Jul 16 11:09:26 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:26 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.281s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-87a19e0d-6a7c-4af4-b7e3-32fad3ba08ff tempest-GroupSnapshotsTest-1630222017 None] Delete group completed successfully. Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (6b4f8668-374b-45e3-8be2-c05e6b47b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81427749-2e95-40cb-8000-7fe4e6bfac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81427749-2e95-40cb-8000-7fe4e6bfac5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1050457443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04bbef4-4905-4985-8ac3-c42fc0dc9dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:26Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec03f864-f5a0-4d4c-b25a-547ea686853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec03f864-f5a0-4d4c-b25a-547ea686853e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583f2d5a-be12-405d-b466-cd8b0e4b9342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (583f2d5a-be12-405d-b466-cd8b0e4b9342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a04bbef4-4905-4985-8ac3-c42fc0dc9dfe', 'volume_name': 'volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b75a9e4-f5fe-44ad-90dc-56ef62a5ab4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b75a9e4-f5fe-44ad-90dc-56ef62a5ab4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8151e38-39f8-417d-8649-ceda9e7fb0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:26 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume a04bbef4-4905-4985-8ac3-c42fc0dc9dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe', 'volume_size': 1} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1050457443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04bbef4-4905-4985-8ac3-c42fc0dc9dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:26Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Creating volume a04bbef4-4905-4985-8ac3-c42fc0dc9dfe {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:26 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:26 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe 1073741824 Jul 16 11:09:26 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:26 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde" returned: 0 in 0.459s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb5e1249-918c-4782-a1d5-75027a7ddb80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:26 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b Jul 16 11:09:26 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d838b936-1ff9-4a3a-a403-a5d1a5827e64 tempest-GroupSnapshotsTest-1630222017 None] Group tempest-GroupSnapshotsTest-Group-1670048390: creating Jul 16 11:09:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d838b936-1ff9-4a3a-a403-a5d1a5827e64 tempest-GroupSnapshotsTest-1630222017 None] Group tempest-GroupSnapshotsTest-Group-1670048390: created successfully Jul 16 11:09:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d838b936-1ff9-4a3a-a403-a5d1a5827e64 tempest-GroupSnapshotsTest-1630222017 None] Create group completed successfully. Jul 16 11:09:26 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe 1073741824" returned: 0 in 0.483s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:26 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b" returned: 0 in 0.408s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:26 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b Jul 16 11:09:26 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:26 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe Jul 16 11:09:26 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:26 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.3530b77a-b6e6-43b5-9023-018908b57f0b" returned: 0 in 0.242s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-3530b77a-b6e6-43b5-9023-018908b57f0b" released by "_delete_snapshot" :: held 1.667s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-cb5e1249-918c-4782-a1d5-75027a7ddb80" released by "delete_snapshot" :: held 1.703s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:27 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe" returned: 0 in 0.263s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8151e38-39f8-417d-8649-ceda9e7fb0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bd443d-8489-4dc9-a2db-7f42f8062df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:27 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe (a04bbef4-4905-4985-8ac3-c42fc0dc9dfe): created successfully Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bd443d-8489-4dc9-a2db-7f42f8062df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (6b4f8668-374b-45e3-8be2-c05e6b47b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:27 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b974d15e-3fdb-4c03-adcf-1d6815e7ccb1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created volume successfully. Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Created reservations ['70275714-8e32-4b94-bea1-400cadba3035', '8c47983d-f348-43c4-9e95-fd0541df9015', '6cc51a62-2973-4b18-814e-9e4dc3df5409', '37ae1e4c-5680-41d6-8bd2-3267f5186894'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:27 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Delete snapshot completed successfully. Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-3530b77a-b6e6-43b5-9023-018908b57f0b-delete_snapshot" released by "delete_snapshot" :: held 1.915s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-4f55d389-dc1e-4e4e-8717-a4f016e76fde-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-4f55d389-dc1e-4e4e-8717-a4f016e76fde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-quobyte-cb5e1249-918c-4782-a1d5-75027a7ddb80" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-cb5e1249-918c-4782-a1d5-75027a7ddb80" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-quobyte-4f55d389-dc1e-4e4e-8717-a4f016e76fde" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-4f55d389-dc1e-4e4e-8717-a4f016e76fde" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Deleting offline snapshot 4f55d389-dc1e-4e4e-8717-a4f016e76fde of volume cb5e1249-918c-4782-a1d5-75027a7ddb80 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] snapshot_file for this snap is: volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb74504-7242-4075-ae95-4140ad40cbd9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:27 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde Jul 16 11:09:27 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:27 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde" returned: 0 in 0.369s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb5e1249-918c-4782-a1d5-75027a7ddb80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e7bc33-b006-40e0-84b7-3d3750502c83]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:27 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 Jul 16 11:09:27 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:28 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80" returned: 0 in 0.367s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:28 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde Jul 16 11:09:28 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Flow 'volume_create_manager' (a31208a7-def7-4596-88ff-2bf5d35268b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7c52c5-70c9-4cbd-8507-53be00cd8795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7c52c5-70c9-4cbd-8507-53be00cd8795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706451464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f6c0512-d89f-4eac-98c4-7562cb172615,host='devstack@QuobyteHD#QuobyteHD',id=ffa0dc49-1719-48d5-a727-e62a2835f07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfe72a767674079a2e017ef7ecf1dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:28Z,use_quota=True,user_id='b7acbf078e154649b73399b21e2bbf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2118811e-b986-492c-8c60-b7c13eca9b38),volume_type_id=2118811e-b986-492c-8c60-b7c13eca9b38)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36b4662-3bc9-4bad-8627-ac8e02fa9476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36b4662-3bc9-4bad-8627-ac8e02fa9476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116a2ff7-006c-4e24-bc14-f8f53714cace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (116a2ff7-006c-4e24-bc14-f8f53714cace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa0dc49-1719-48d5-a727-e62a2835f07f', 'volume_name': 'volume-ffa0dc49-1719-48d5-a727-e62a2835f07f', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4a0ee8-1c9a-4215-8192-92bafe8c9710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4a0ee8-1c9a-4215-8192-92bafe8c9710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61612f21-aca5-4648-88f2-8b11778b5743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:28 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Volume ffa0dc49-1719-48d5-a727-e62a2835f07f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa0dc49-1719-48d5-a727-e62a2835f07f', 'volume_size': 1} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f6c0512-d89f-4eac-98c4-7562cb172615,created_at=2026-07-16T09:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706451464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f6c0512-d89f-4eac-98c4-7562cb172615,host='devstack@QuobyteHD#QuobyteHD',id=ffa0dc49-1719-48d5-a727-e62a2835f07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfe72a767674079a2e017ef7ecf1dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:28Z,use_quota=True,user_id='b7acbf078e154649b73399b21e2bbf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2118811e-b986-492c-8c60-b7c13eca9b38),volume_type_id=2118811e-b986-492c-8c60-b7c13eca9b38)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Creating volume ffa0dc49-1719-48d5-a727-e62a2835f07f {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:28 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:28 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f 1073741824 Jul 16 11:09:28 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:28 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde" returned: 0 in 0.405s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:28 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde Jul 16 11:09:28 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:28 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f 1073741824" returned: 0 in 0.522s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:28 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80.4f55d389-dc1e-4e4e-8717-a4f016e76fde" returned: 0 in 0.270s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (a4dde4dc-79fa-4b69-839a-b3a104eb3627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad0e44a-d74c-4245-a041-64411771ff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-4f55d389-dc1e-4e4e-8717-a4f016e76fde" released by "_delete_snapshot" :: held 1.549s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad0e44a-d74c-4245-a041-64411771ff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-510659265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9171811-97db-435b-864f-70ee512a5552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:29Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbec3a8c-2877-4d2c-9537-e1a480f9be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbec3a8c-2877-4d2c-9537-e1a480f9be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9400f6a-2012-432d-8be6-1ec0aaecaad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9400f6a-2012-432d-8be6-1ec0aaecaad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9171811-97db-435b-864f-70ee512a5552', 'volume_name': 'volume-a9171811-97db-435b-864f-70ee512a5552', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846a20a4-bbb8-4b2a-a5ee-e15ef44856a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846a20a4-bbb8-4b2a-a5ee-e15ef44856a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca14fc8-0d10-40f6-940a-588e1f62c5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:28 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume a9171811-97db-435b-864f-70ee512a5552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9171811-97db-435b-864f-70ee512a5552', 'volume_size': 1} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-cb5e1249-918c-4782-a1d5-75027a7ddb80" released by "delete_snapshot" :: held 1.609s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:28 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f Jul 16 11:09:28 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Created reservations ['8317a817-d3fb-4874-8078-bd859ea53f6c', '0348ed0d-570b-4564-b05f-8873cc41149a', 'a959d88d-c94d-4157-91e8-306ec1616f8e', 'a75186b3-8025-4f3e-b9d0-aa47eb40b3f8'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Delete snapshot completed successfully. Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-4f55d389-dc1e-4e4e-8717-a4f016e76fde-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Snapshots deleted, issuing volume delete {{(pid=87345) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-quobyte-cb5e1249-918c-4782-a1d5-75027a7ddb80" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-cb5e1249-918c-4782-a1d5-75027a7ddb80" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[efca27de-5044-40b0-8104-bb856bacb279]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (9eed46df-d850-4d97-806b-26c0cdc161b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8361b63a-5437-437d-b4d3-ff1fbf1fbab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8361b63a-5437-437d-b4d3-ff1fbf1fbab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1008465621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:29Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a294e6-9de1-47dd-9edc-a2cb32585211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9a294e6-9de1-47dd-9edc-a2cb32585211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4b9abf-7784-4154-9edc-4a664c854170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4b9abf-7784-4154-9edc-4a664c854170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf', 'volume_name': 'volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbaa395-bac7-40e0-8738-f9d77796054f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbaa395-bac7-40e0-8738-f9d77796054f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8966c80a-b577-494e-91b4-39f2e3ad6794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf', 'volume_size': 1} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:29 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f" returned: 0 in 0.400s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:29 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 Jul 16 11:09:29 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.432s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-510659265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9171811-97db-435b-864f-70ee512a5552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:29Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Creating volume a9171811-97db-435b-864f-70ee512a5552 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:29 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:29 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552 1073741824 Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61612f21-aca5-4648-88f2-8b11778b5743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa0dc49-1719-48d5-a727-e62a2835f07f', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2775d1-7105-43ac-9073-609400999733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Volume volume-ffa0dc49-1719-48d5-a727-e62a2835f07f (ffa0dc49-1719-48d5-a727-e62a2835f07f): created successfully Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2775d1-7105-43ac-9073-609400999733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Flow 'volume_create_manager' (a31208a7-def7-4596-88ff-2bf5d35268b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:29 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a798af38-fe11-42bb-96ea-cb59b7f6798b tempest-GroupSnapshotsTest-1630222017 None] Created volume successfully. Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (e4b4b02a-0a79-48a2-8801-a6a7bdc26d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3082c3-bc1d-440e-8c07-41fdc9ce0c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3082c3-bc1d-440e-8c07-41fdc9ce0c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-10308956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e097e53b-62e9-4d5c-8f6a-409a959bc6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:29Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b9da65-fe8f-4514-9632-563a74b37dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b9da65-fe8f-4514-9632-563a74b37dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605e365b-f040-4996-a95a-f7bbaf275b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605e365b-f040-4996-a95a-f7bbaf275b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e097e53b-62e9-4d5c-8f6a-409a959bc6ce', 'volume_name': 'volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c658369-fd8e-4fcb-b08b-d33da9ca7a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c658369-fd8e-4fcb-b08b-d33da9ca7a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8d5921-12d6-41fd-97f0-64c51509e591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume e097e53b-62e9-4d5c-8f6a-409a959bc6ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce', 'volume_size': 1} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:29 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80" returned: 0 in 0.563s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:29 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80 Jul 16 11:09:29 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (c30bcdcb-9421-4980-b74f-28fc85e94dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef65627d-8c43-4133-a154-ede27157ffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef65627d-8c43-4133-a154-ede27157ffca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1633249516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83d838a-802e-4c05-aab7-2e7c5f72d06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:30Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c8c96e-f5c5-4af3-8263-4599abe84f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c8c96e-f5c5-4af3-8263-4599abe84f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63da3ee3-c156-40d6-b06a-40bc98b24171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63da3ee3-c156-40d6-b06a-40bc98b24171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a83d838a-802e-4c05-aab7-2e7c5f72d06a', 'volume_name': 'volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e084fc3-bc29-41b6-a154-c9b08d980c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e084fc3-bc29-41b6-a154-c9b08d980c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b03b56-8332-4765-be6c-4f2f7926bd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:29 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:29 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume a83d838a-802e-4c05-aab7-2e7c5f72d06a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a', 'volume_size': 1} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552 1073741824" returned: 0 in 0.656s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb5e1249-918c-4782-a1d5-75027a7ddb80" returned: 0 in 0.319s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-cb5e1249-918c-4782-a1d5-75027a7ddb80" released by "delete_volume" :: held 0.965s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:30 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552 Jul 16 11:09:30 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Created reservations ['66d26833-79cc-4b7e-859e-4b65108d47d7', '24899238-a5b0-4eae-8698-747923e69378', 'de0eaaf4-f303-4f5c-abbc-26c62a60f756', '515091d4-98e4-444d-b6e8-32a6708c1c0b'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:30 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:30 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:30 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (1d1aeb00-5bb7-4453-8390-647be2b5842b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d3793c-2ea1-4758-937e-0780f1e46b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552" returned: 0 in 0.295s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1008465621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:29Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Creating volume e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:30 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d3793c-2ea1-4758-937e-0780f1e46b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1183490073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2739305f-a306-4710-9424-7faeb598578c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:30Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b616e0-1b8b-479c-a0de-13381c0db75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:30 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf 1073741824 Jul 16 11:09:30 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b616e0-1b8b-479c-a0de-13381c0db75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef34690a-2ac1-42d9-a2da-0285ed904d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef34690a-2ac1-42d9-a2da-0285ed904d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2739305f-a306-4710-9424-7faeb598578c', 'volume_name': 'volume-2739305f-a306-4710-9424-7faeb598578c', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc024675-b13e-4bf6-a4a5-c9f8b8b54a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc024675-b13e-4bf6-a4a5-c9f8b8b54a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d1a6fd-9884-4ea8-9b74-70064f6f87df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:30 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume 2739305f-a306-4710-9424-7faeb598578c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2739305f-a306-4710-9424-7faeb598578c', 'volume_size': 1} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca14fc8-0d10-40f6-940a-588e1f62c5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9171811-97db-435b-864f-70ee512a5552', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38847896-0f5a-42c8-bfcd-d00dde0575ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:30 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume volume-a9171811-97db-435b-864f-70ee512a5552 (a9171811-97db-435b-864f-70ee512a5552): created successfully Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38847896-0f5a-42c8-bfcd-d00dde0575ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (a4dde4dc-79fa-4b69-839a-b3a104eb3627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:30 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-71aab216-619e-4775-be14-5b56c7b0eb68 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created volume successfully. Jul 16 11:09:30 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.330s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:30 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Deleted volume successfully. Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0954298a-3e70-46b1-91b0-981440e95f2e tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-cb5e1249-918c-4782-a1d5-75027a7ddb80-delete_volume" released by "delete_volume" :: held 5.306s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:30 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf 1073741824" returned: 0 in 0.513s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:30 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf Jul 16 11:09:30 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:31 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf" returned: 0 in 0.311s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.610s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-10308956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e097e53b-62e9-4d5c-8f6a-409a959bc6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:29Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Creating volume e097e53b-62e9-4d5c-8f6a-409a959bc6ce {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:31 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:31 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce 1073741824 Jul 16 11:09:31 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8966c80a-b577-494e-91b4-39f2e3ad6794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152d7ae9-70ea-4bee-8e01-f482bf5121ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf (e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf): created successfully Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152d7ae9-70ea-4bee-8e01-f482bf5121ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (9eed46df-d850-4d97-806b-26c0cdc161b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Flow 'volume_create_manager' (fd773164-745a-4cd4-a465-7511c831f21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5e2d82-1181-493b-b033-8d444b45e4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-37eae28c-ad0f-4fa5-b19c-6c7679af2fe1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created volume successfully. Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5e2d82-1181-493b-b033-8d444b45e4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1918374981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f6c0512-d89f-4eac-98c4-7562cb172615,host='devstack@QuobyteHD#QuobyteHD',id=c96ac102-a241-4d98-89cf-63d4a956a2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfe72a767674079a2e017ef7ecf1dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:31Z,use_quota=True,user_id='b7acbf078e154649b73399b21e2bbf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2118811e-b986-492c-8c60-b7c13eca9b38),volume_type_id=2118811e-b986-492c-8c60-b7c13eca9b38)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b88945-390e-45c9-a3aa-cb6a531d16d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b88945-390e-45c9-a3aa-cb6a531d16d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b78341-6456-4d3a-95d5-a967d3f1fa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b78341-6456-4d3a-95d5-a967d3f1fa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96ac102-a241-4d98-89cf-63d4a956a2eb', 'volume_name': 'volume-c96ac102-a241-4d98-89cf-63d4a956a2eb', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a35e4f-4d35-4b60-9202-ccda5b713237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a35e4f-4d35-4b60-9202-ccda5b713237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0820af9c-7451-417d-8ca4-13bcdddbe0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Volume c96ac102-a241-4d98-89cf-63d4a956a2eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96ac102-a241-4d98-89cf-63d4a956a2eb', 'volume_size': 1} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Flow 'volume_create_manager' (d0311dad-eda9-44c2-9e50-2468e18e7682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd5bd89-a4fd-45c2-8669-d2a1723b9a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd5bd89-a4fd-45c2-8669-d2a1723b9a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-132410248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20cd986-4e2e-45b1-b4fb-8d3af58172d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e6d90098374405b09a612cbc4f2330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:31Z,use_quota=True,user_id='7cdb80d5fb244e2990a0e3c2e38cfd36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0efc50d-1490-4b2f-ab4b-4e768ecf0eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0efc50d-1490-4b2f-ab4b-4e768ecf0eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99b139a-a93d-4264-8fbf-593b0199fa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99b139a-a93d-4264-8fbf-593b0199fa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20cd986-4e2e-45b1-b4fb-8d3af58172d9', 'volume_name': 'volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84632344-7123-4e15-98d4-175e91ccea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84632344-7123-4e15-98d4-175e91ccea01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20237202-0c5b-4fea-baab-a41fb137c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Volume b20cd986-4e2e-45b1-b4fb-8d3af58172d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9', 'volume_size': 1} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:31 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce 1073741824" returned: 0 in 0.426s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:31 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce Jul 16 11:09:31 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:31 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce" returned: 0 in 0.236s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.958s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1633249516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83d838a-802e-4c05-aab7-2e7c5f72d06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:30Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Creating volume a83d838a-802e-4c05-aab7-2e7c5f72d06a {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:31 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8d5921-12d6-41fd-97f0-64c51509e591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a 1073741824 Jul 16 11:09:31 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decf9425-ae7e-4f62-b8cb-5b8d33a3a6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:31 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce (e097e53b-62e9-4d5c-8f6a-409a959bc6ce): created successfully Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decf9425-ae7e-4f62-b8cb-5b8d33a3a6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (e4b4b02a-0a79-48a2-8801-a6a7bdc26d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:31 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9a9ec472-95d0-44ed-92e4-bd53ceb496a9 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created volume successfully. Jul 16 11:09:32 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a 1073741824" returned: 0 in 0.429s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:32 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a Jul 16 11:09:32 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:32 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a" returned: 0 in 0.244s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.252s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1183490073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2739305f-a306-4710-9424-7faeb598578c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efc45df1654396bdc18fb272efaeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:30Z,use_quota=True,user_id='11fae30bb227454fa28d23394ae1f913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Creating volume 2739305f-a306-4710-9424-7faeb598578c {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:32 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:32 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c 1073741824 Jul 16 11:09:32 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b03b56-8332-4765-be6c-4f2f7926bd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ac2dc1-3eab-497e-85b5-4ee8a03161a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:32 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a (a83d838a-802e-4c05-aab7-2e7c5f72d06a): created successfully Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ac2dc1-3eab-497e-85b5-4ee8a03161a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (c30bcdcb-9421-4980-b74f-28fc85e94dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:32 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-40bbdbfc-7c1a-405e-9fb3-2b843ab6b7a6 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created volume successfully. Jul 16 11:09:33 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c 1073741824" returned: 0 in 0.394s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:33 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c Jul 16 11:09:33 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:33 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.906s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f6c0512-d89f-4eac-98c4-7562cb172615,created_at=2026-07-16T09:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1918374981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f6c0512-d89f-4eac-98c4-7562cb172615,host='devstack@QuobyteHD#QuobyteHD',id=c96ac102-a241-4d98-89cf-63d4a956a2eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfe72a767674079a2e017ef7ecf1dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:31Z,use_quota=True,user_id='b7acbf078e154649b73399b21e2bbf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2118811e-b986-492c-8c60-b7c13eca9b38),volume_type_id=2118811e-b986-492c-8c60-b7c13eca9b38)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Creating volume c96ac102-a241-4d98-89cf-63d4a956a2eb {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:33 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d1a6fd-9884-4ea8-9b74-70064f6f87df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2739305f-a306-4710-9424-7faeb598578c', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:33 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb 1073741824 Jul 16 11:09:33 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868c7205-7827-4c4a-9349-051f1144e605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:33 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Volume volume-2739305f-a306-4710-9424-7faeb598578c (2739305f-a306-4710-9424-7faeb598578c): created successfully Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868c7205-7827-4c4a-9349-051f1144e605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Flow 'volume_create_manager' (1d1aeb00-5bb7-4453-8390-647be2b5842b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:33 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e37fdc4a-b711-4cb9-b8ad-041b10382a1d tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created volume successfully. Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-2739305f-a306-4710-9424-7faeb598578c-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-2739305f-a306-4710-9424-7faeb598578c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-quobyte-2739305f-a306-4710-9424-7faeb598578c" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-2739305f-a306-4710-9424-7faeb598578c" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cf6b9b-32a3-4d3e-859f-74e5d2e07ccc]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:33 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb 1073741824" returned: 0 in 0.479s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:33 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c Jul 16 11:09:33 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:33 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb Jul 16 11:09:33 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:34 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb" returned: 0 in 0.245s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.581s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-132410248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20cd986-4e2e-45b1-b4fb-8d3af58172d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e6d90098374405b09a612cbc4f2330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:31Z,use_quota=True,user_id='7cdb80d5fb244e2990a0e3c2e38cfd36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Creating volume b20cd986-4e2e-45b1-b4fb-8d3af58172d9 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:34 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:34 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c" returned: 0 in 0.376s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:34 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 1073741824 Jul 16 11:09:34 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0820af9c-7451-417d-8ca4-13bcdddbe0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96ac102-a241-4d98-89cf-63d4a956a2eb', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47326e8c-8291-4136-96f4-bd48b6fbf272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:34 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c Jul 16 11:09:34 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:34 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Volume volume-c96ac102-a241-4d98-89cf-63d4a956a2eb (c96ac102-a241-4d98-89cf-63d4a956a2eb): created successfully Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47326e8c-8291-4136-96f4-bd48b6fbf272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Flow 'volume_create_manager' (fd773164-745a-4cd4-a465-7511c831f21f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-03a81234-1c78-4c48-9604-9b67c6f76405 tempest-GroupSnapshotsTest-1630222017 None] Created volume successfully. Jul 16 11:09:34 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2739305f-a306-4710-9424-7faeb598578c" returned: 0 in 0.266s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-2739305f-a306-4710-9424-7faeb598578c" released by "delete_volume" :: held 0.690s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created reservations ['499b9885-1930-4f74-81b2-e46ea430be7d', 'f7dbfb68-bf2e-4f57-bf5e-3472e0389946', 'fa4eb9fd-eee5-4785-b837-b394b2468140', '3288379f-55fb-4317-84b9-9f26ff49fcba'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:34 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:34 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:34 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 1073741824" returned: 0 in 0.474s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:34 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 Jul 16 11:09:34 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:34 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:34 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:34 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.307s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Deleted volume successfully. Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6f05e888-3bcc-4cf9-a77f-6708c38a6efd tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-2739305f-a306-4710-9424-7faeb598578c-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-a83d838a-802e-4c05-aab7-2e7c5f72d06a-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ee3cc0c4-6401-4796-aa43-1c8daf53c972 tempest-GroupSnapshotsTest-1630222017 None] Update group completed successfully. Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-a83d838a-802e-4c05-aab7-2e7c5f72d06a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:34 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" returned: 0 in 0.333s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20237202-0c5b-4fea-baab-a41fb137c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cc2962-5f0f-4c8d-964a-3311bd5f61d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-quobyte-a83d838a-802e-4c05-aab7-2e7c5f72d06a" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:34 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Volume volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 (b20cd986-4e2e-45b1-b4fb-8d3af58172d9): created successfully Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88cc2962-5f0f-4c8d-964a-3311bd5f61d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Flow 'volume_create_manager' (d0311dad-eda9-44c2-9e50-2468e18e7682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-a83d838a-802e-4c05-aab7-2e7c5f72d06a" acquired by "delete_volume" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5952fdec-9989-472d-a30a-8abfcf53a84b tempest-VolumesDeleteCascade-1342360920 None] Created volume successfully. Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[401b3c0e-e34a-4ab3-aa14-d8aed38c830f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:35 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.365s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:09:35 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a Jul 16 11:09:35 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:35 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a" returned: 0 in 0.362s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:35 devstack sudo[97638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a Jul 16 11:09:35 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] Creating offline snapshot 0f9ec2b7-159a-4003-9221-e5dfe84d56b0 of volume b20cd986-4e2e-45b1-b4fb-8d3af58172d9 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec104530-bc9f-41d8-b470-e1ba02d7959d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:35 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a83d838a-802e-4c05-aab7-2e7c5f72d06a" returned: 0 in 0.285s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-a83d838a-802e-4c05-aab7-2e7c5f72d06a" released by "delete_volume" :: held 0.692s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created reservations ['313b327d-a9b7-4ea2-ab0d-b0df5f4b80cb', '66b5ad47-ae64-49fd-beb4-7f3017740f84', 'd5ef6195-7dff-48e3-afbe-bc58de6d75ec', '143bc5b3-c3ad-4c00-aab9-231b0c03019f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:35 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 Jul 16 11:09:35 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:35 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:35 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:36 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b9930fd9-6aa9-4b58-b3fe-567a539502b8 tempest-GroupSnapshotsTest-1630222017 None] Update group completed successfully. Jul 16 11:09:36 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" returned: 0 in 0.396s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-e097e53b-62e9-4d5c-8f6a-409a959bc6ce-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:36 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 1G Jul 16 11:09:36 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-e097e53b-62e9-4d5c-8f6a-409a959bc6ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:36 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.297s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:36 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Deleted volume successfully. Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-quobyte-e097e53b-62e9-4d5c-8f6a-409a959bc6ce" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1aef622a-17b4-4206-ae78-e2ef2d5c02c1 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-a83d838a-802e-4c05-aab7-2e7c5f72d06a-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-e097e53b-62e9-4d5c-8f6a-409a959bc6ce" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5531b486-cdfc-42f6-b4fc-7ca1b1f69c5e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:36 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce Jul 16 11:09:36 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:36 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 1G" returned: 0 in 0.442s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:36 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 Jul 16 11:09:36 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:36 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce" returned: 0 in 0.393s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:36 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce Jul 16 11:09:36 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:36 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0" returned: 0 in 0.304s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:36 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 is being set with open permissions: ugo+rw Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:36 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 Jul 16 11:09:36 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:36 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e097e53b-62e9-4d5c-8f6a-409a959bc6ce" returned: 0 in 0.268s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-e097e53b-62e9-4d5c-8f6a-409a959bc6ce" released by "delete_volume" :: held 0.703s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created reservations ['867409df-203f-43dd-b183-fb43ca846c2a', 'f7e4d55b-79cd-424c-96f1-5b2fb7fb9797', 'e82b1089-5792-4104-b0de-37e4be55c36b', '0e55c6de-c310-4647-b28b-42d853dd351f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:37 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:37 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:37 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0" returned: 0 in 0.269s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:37 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6af28df6-c775-4907-99e0-58d1507e3758 tempest-GroupSnapshotsTest-1630222017 None] Update group completed successfully. Jul 16 11:09:37 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.info Jul 16 11:09:37 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:37 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.341s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:37 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Deleted volume successfully. Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-quobyte-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fab4bcde-3b1b-4f83-b7a8-4e7af14ce9da tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-e097e53b-62e9-4d5c-8f6a-409a959bc6ce-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4151086-08cc-4ab1-8c6e-8685b27cae49]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:37 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.info" returned: 0 in 0.305s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:37 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.info is being set with open permissions: ugo+rw Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:37 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.info Jul 16 11:09:37 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:37 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf Jul 16 11:09:37 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:37 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.info" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:37 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf" returned: 0 in 0.375s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:37 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a56c763a-efa0-4f88-acb3-d653b03ba7d4 tempest-VolumesDeleteCascade-1342360920 None] Create snapshot completed successfully Jul 16 11:09:37 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf Jul 16 11:09:37 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:38 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf" returned: 0 in 0.237s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf" released by "delete_volume" :: held 0.652s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created reservations ['626dea37-3e01-421d-b11a-c3c792052572', '97dc9dc8-3052-43b9-8f7d-e8387cb06723', '771dbe49-f400-456a-a05b-907262225e2a', '46a421ef-3e8d-4c97-b0fb-a27783e4479e'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:38 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:38 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c022d87f-c333-4ff6-9bc0-c071620083e6 tempest-GroupSnapshotsTest-1630222017 None] Update group completed successfully. Jul 16 11:09:38 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.258s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Deleted volume successfully. Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8efde048-e6ce-4259-b4b8-bff75edf5674 tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-e92e2a8e-ca3b-4f16-b5ef-b86b1b0bd6bf-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-a9171811-97db-435b-864f-70ee512a5552-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-a9171811-97db-435b-864f-70ee512a5552-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-quobyte-a9171811-97db-435b-864f-70ee512a5552" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-a9171811-97db-435b-864f-70ee512a5552" acquired by "delete_volume" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9db3eab-f8bb-413a-b9b3-9077384dd467]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:38 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552 Jul 16 11:09:38 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:38 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552" returned: 0 in 0.367s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:38 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552 Jul 16 11:09:38 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:39 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a9171811-97db-435b-864f-70ee512a5552" returned: 0 in 0.257s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-a9171811-97db-435b-864f-70ee512a5552" released by "delete_volume" :: held 0.666s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created reservations ['9fcf922a-0e8c-4d80-9098-d69e651d4032', '5b72242a-4eff-493b-a009-5b103aa6f766', 'e524218f-bfba-46a5-81ec-b6999cb01ae5', '922da956-6b83-4397-baed-df9864fe2c00'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Flow 'volume_create_manager' (6b7b9f80-8dbf-4ec3-a48f-1c2b7399f057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd8b6f6-cc07-40f6-95be-de09622ffeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd8b6f6-cc07-40f6-95be-de09622ffeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1416591376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf6fd0f-c386-4de5-b67a-ff3fbf68a606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e6d90098374405b09a612cbc4f2330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f9ec2b7-159a-4003-9221-e5dfe84d56b0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:39Z,use_quota=True,user_id='7cdb80d5fb244e2990a0e3c2e38cfd36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09908480-f29a-4db0-9a95-a3eb302cbe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09908480-f29a-4db0-9a95-a3eb302cbe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9935f4d0-c042-4875-9fc6-8c30205350f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9935f4d0-c042-4875-9fc6-8c30205350f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4cf6fd0f-c386-4de5-b67a-ff3fbf68a606', 'volume_name': 'volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606', 'volume_size': 1, 'snapshot_id': '0f9ec2b7-159a-4003-9221-e5dfe84d56b0'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e920d0-88c0-4753-a586-5f4d5499ceee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e920d0-88c0-4753-a586-5f4d5499ceee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485e17f4-ad07-491b-91d3-da95214e8f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:39 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Volume 4cf6fd0f-c386-4de5-b67a-ff3fbf68a606: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606', 'volume_size': 1, 'snapshot_id': '0f9ec2b7-159a-4003-9221-e5dfe84d56b0'} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-quobyte-0f9ec2b7-159a-4003-9221-e5dfe84d56b0-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" by "_create_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-0f9ec2b7-159a-4003-9221-e5dfe84d56b0-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Creating volume 4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 from snapshot 0f9ec2b7-159a-4003-9221-e5dfe84d56b0 {{(pid=87345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:39 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:39 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-quobyte-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] snapshot: 0f9ec2b7-159a-4003-9221-e5dfe84d56b0, volume: 4cf6fd0f-c386-4de5-b67a-ff3fbf68a606, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3744c52f-ff1a-4068-aab0-d31cbadc26d9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:39 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 Jul 16 11:09:39 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "cinder-quobyte-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:39 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.325s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:39 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Deleted volume successfully. Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcc2a86-f39c-4785-9561-88c75a0bcff2]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e0510816-66d9-4a91-b3b0-1ad229b40d2b tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-a9171811-97db-435b-864f-70ee512a5552-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:39 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe Jul 16 11:09:39 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:39 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] GroupSnapshot be0646ea-498f-4a39-b528-729984ee3614: creating. Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Group snapshot be0646ea-498f-4a39-b528-729984ee3614: creating. {{(pid=87345) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 11:09:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:40 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0" returned: 0 in 0.509s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbd521a-7fff-4227-9ae2-affcc48d9468]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:40 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 Jul 16 11:09:40 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:40 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe" returned: 0 in 0.402s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:40 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe Jul 16 11:09:40 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:40 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" returned: 0 in 0.369s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:40 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe" returned: 0 in 0.258s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-quobyte-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe" released by "delete_volume" :: held 0.709s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:40 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 Jul 16 11:09:40 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Created reservations ['d815d30b-93eb-4168-a9d4-34d7f4b01ad0', 'f753f15a-464a-422e-a2e3-0cae64b7caf4', '62046be7-2f63-4a48-9adf-bde473a8c597', 'd14ab558-54ae-4cde-a98d-5216290ce72c'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:40 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:40 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:40 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.265s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Deleted volume successfully. Jul 16 11:09:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-484c4def-5f7d-487e-b1ae-18573cd2689c tempest-CreateVolumesFromSourceVolumeTest-1324661044 None] Lock "cinder-a04bbef4-4905-4985-8ac3-c42fc0dc9dfe-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:45 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" returned: 0 in 4.847s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:45 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ede23d0-7769-4478-b513-2ce9141a8098]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:45 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 Jul 16 11:09:45 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:45 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" returned: 0 in 0.541s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:45 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:09:45 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Converted 1024.00 MB image at 211.22 MB/s Jul 16 11:09:45 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 is being set with open permissions: ugo+rw Jul 16 11:09:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:45 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 Jul 16 11:09:45 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:46 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" returned: 0 in 0.253s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" released by "_copy_volume_from_snapshot" :: held 6.628s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-0f9ec2b7-159a-4003-9221-e5dfe84d56b0-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" released by "_create_volume_from_snapshot" :: held 6.672s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.711s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.151s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Creating offline snapshot 635e8963-7c5c-4f9d-a5b4-ed11cff680dc of volume ffa0dc49-1719-48d5-a727-e62a2835f07f {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485e17f4-ad07-491b-91d3-da95214e8f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606', 'volume_size': 1, 'snapshot_id': '0f9ec2b7-159a-4003-9221-e5dfe84d56b0'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf2b6ab-91bf-4ae2-a5ba-818c3568245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d19036-2a24-475d-ac18-a7c646a9fa70]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:46 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Volume volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 (4cf6fd0f-c386-4de5-b67a-ff3fbf68a606): created successfully Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf2b6ab-91bf-4ae2-a5ba-818c3568245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Flow 'volume_create_manager' (6b7b9f80-8dbf-4ec3-a48f-1c2b7399f057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:46 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-446dd8c0-0fd3-481c-b49d-eb38c9af1016 tempest-VolumesDeleteCascade-1342360920 None] Created volume successfully. Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Flow 'volume_create_manager' (f77b787d-8dec-4e98-88c1-2f0a39c622a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b745ff31-a4d2-4c6d-b425-ff555beff2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b745ff31-a4d2-4c6d-b425-ff555beff2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-403364519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce63134b-b39f-4714-be48-084b793cd590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d739ec39bd3b4972aacaf8320e6d64e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:46Z,use_quota=True,user_id='3ea53639eb2d418182c785fa6656f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:46 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f Jul 16 11:09:46 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71187f3-1ce2-4e1b-8ada-11f93960706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71187f3-1ce2-4e1b-8ada-11f93960706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69567694-1e1a-46b8-a7f6-71a8cb82b06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69567694-1e1a-46b8-a7f6-71a8cb82b06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce63134b-b39f-4714-be48-084b793cd590', 'volume_name': 'volume-ce63134b-b39f-4714-be48-084b793cd590', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa32c1c-8e53-407e-a1be-a953699c88fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa32c1c-8e53-407e-a1be-a953699c88fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a002902f-e701-4123-9664-cec7af266075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:46 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Volume ce63134b-b39f-4714-be48-084b793cd590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce63134b-b39f-4714-be48-084b793cd590', 'volume_size': 1} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:46 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f" returned: 0 in 0.356s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:46 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc 1G Jul 16 11:09:46 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:46 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc 1G" returned: 0 in 0.369s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa0dc49-1719-48d5-a727-e62a2835f07f -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:46 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa0dc49-1719-48d5-a727-e62a2835f07f -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc Jul 16 11:09:46 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-b20cd986-4e2e-45b1-b4fb-8d3af58172d9-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:47 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-b20cd986-4e2e-45b1-b4fb-8d3af58172d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa0dc49-1719-48d5-a727-e62a2835f07f -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc" returned: 0 in 0.305s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:47 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:47 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc Jul 16 11:09:47 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Performing cascade delete. {{(pid=87345) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-0f9ec2b7-159a-4003-9221-e5dfe84d56b0-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-0f9ec2b7-159a-4003-9221-e5dfe84d56b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-quobyte-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-quobyte-0f9ec2b7-159a-4003-9221-e5dfe84d56b0" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-0f9ec2b7-159a-4003-9221-e5dfe84d56b0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Deleting offline snapshot 0f9ec2b7-159a-4003-9221-e5dfe84d56b0 of volume b20cd986-4e2e-45b1-b4fb-8d3af58172d9 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] snapshot_file for this snap is: volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a21f6a-fcf6-4b8e-86cc-2a1245a74680]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:47 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:47 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 Jul 16 11:09:47 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:47 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.info Jul 16 11:09:47 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:47 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72feeb9-e4be-4a04-a350-54d4872eb41e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:47 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.info" returned: 0 in 0.248s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:47 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:47 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.info Jul 16 11:09:47 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:47 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 Jul 16 11:09:47 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:47 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.info" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Creating offline snapshot d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 of volume c96ac102-a241-4d98-89cf-63d4a956a2eb {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d091cc4-f7f9-4057-91be-bbe4db6fc0e9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:48 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" returned: 0 in 0.365s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:48 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 Jul 16 11:09:48 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:48 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb Jul 16 11:09:48 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:48 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb" returned: 0 in 0.373s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:48 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0" returned: 0 in 0.349s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:48 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 1G Jul 16 11:09:48 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:48 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0 Jul 16 11:09:48 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:48 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9.0f9ec2b7-159a-4003-9221-e5dfe84d56b0" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-0f9ec2b7-159a-4003-9221-e5dfe84d56b0" released by "_delete_snapshot" :: held 1.388s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" released by "delete_snapshot" :: held 1.412s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Created reservations ['626bd918-fab1-4a4f-8a89-ec0756fd5ee4', '3b0a93d3-d488-4325-b168-2c578e41568e', '9db722a8-cfb5-40ce-8c25-a537fc2d0948', '552893bc-49c2-4e92-bc2b-c7f02a77633f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:48 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 1G" returned: 0 in 0.406s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96ac102-a241-4d98-89cf-63d4a956a2eb -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:48 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96ac102-a241-4d98-89cf-63d4a956a2eb -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 Jul 16 11:09:48 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:48 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Delete snapshot completed successfully. Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-0f9ec2b7-159a-4003-9221-e5dfe84d56b0-delete_snapshot" released by "delete_snapshot" :: held 1.582s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Snapshots deleted, issuing volume delete {{(pid=87345) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-quobyte-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[684bd322-561d-4968-ac3d-7d97c63b19a6]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:49 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 Jul 16 11:09:49 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:49 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96ac102-a241-4d98-89cf-63d4a956a2eb -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1" returned: 0 in 0.281s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:49 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:49 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 Jul 16 11:09:49 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:49 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" returned: 0 in 0.345s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:49 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9 Jul 16 11:09:49 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:49 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1" returned: 0 in 0.263s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:49 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.info Jul 16 11:09:49 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:49 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" returned: 0 in 0.278s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-b20cd986-4e2e-45b1-b4fb-8d3af58172d9" released by "delete_volume" :: held 0.680s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Created reservations ['019c44ad-1500-4232-b1b5-4a940fb1f423', '039f6d3b-c6c9-4e06-afbc-80a04b283373', 'b621d996-b8ff-45c8-808c-67a4d82559fa', '3f2edf3f-efb7-49b2-baf0-e6900ffaf976'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:49 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.info" returned: 0 in 0.254s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:49 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:49 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.info Jul 16 11:09:49 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:49 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:49 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:49 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.info" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.570s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-403364519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce63134b-b39f-4714-be48-084b793cd590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d739ec39bd3b4972aacaf8320e6d64e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:46Z,use_quota=True,user_id='3ea53639eb2d418182c785fa6656f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Creating volume ce63134b-b39f-4714-be48-084b793cd590 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:49 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:49 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.258s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:49 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 1073741824 Jul 16 11:09:49 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:49 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Deleted volume successfully. Jul 16 11:09:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4e3554af-9c24-4d3a-978b-6ca1ba6554a2 tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-b20cd986-4e2e-45b1-b4fb-8d3af58172d9-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4df317c1-3795-44e5-ab99-d1d764ab9afe tempest-GroupSnapshotsTest-1630222017 None] group_snapshot be0646ea-498f-4a39-b528-729984ee3614: created successfully Jul 16 11:09:50 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 1073741824" returned: 0 in 0.399s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:50 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 Jul 16 11:09:50 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:50 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a002902f-e701-4123-9664-cec7af266075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce63134b-b39f-4714-be48-084b793cd590', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d67866-6567-48d1-9421-122de0e8f1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:50 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Volume volume-ce63134b-b39f-4714-be48-084b793cd590 (ce63134b-b39f-4714-be48-084b793cd590): created successfully Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d67866-6567-48d1-9421-122de0e8f1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Flow 'volume_create_manager' (f77b787d-8dec-4e98-88c1-2f0a39c622a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "cinder-quobyte-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-161c1470-cb4c-4ac7-9641-15b68c69068f tempest-VolumeDependencyTests-1186433838 None] Created volume successfully. Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" acquired by "delete_volume" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a2fbdc-e00d-4b60-a99e-264cab2a8295]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] group_snapshot be0646ea-498f-4a39-b528-729984ee3614: deleting Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] group_snapshot be0646ea-498f-4a39-b528-729984ee3614: deleting {{(pid=87345) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-ffa0dc49-1719-48d5-a727-e62a2835f07f" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-ffa0dc49-1719-48d5-a727-e62a2835f07f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-635e8963-7c5c-4f9d-a5b4-ed11cff680dc" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-635e8963-7c5c-4f9d-a5b4-ed11cff680dc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Deleting offline snapshot 635e8963-7c5c-4f9d-a5b4-ed11cff680dc of volume ffa0dc49-1719-48d5-a727-e62a2835f07f {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:09:50 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 Jul 16 11:09:50 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] snapshot_file for this snap is: volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaaa367-24a5-4e5c-832f-613128de1ec5]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:50 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc Jul 16 11:09:50 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:51 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" returned: 0 in 0.377s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:51 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606 Jul 16 11:09:51 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:51 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc" returned: 0 in 0.365s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffa0dc49-1719-48d5-a727-e62a2835f07f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc13152-a5d6-43c1-85fc-43eedee2037a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:51 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-quobyte-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606" released by "delete_volume" :: held 0.668s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:51 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f Jul 16 11:09:51 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Created reservations ['8a34555a-5d5c-4124-a091-e39ed56501cc', 'b318884b-d2ca-4427-bd1d-8291efffbb89', 'ab9250a1-0478-48d3-992c-61c781b95661', '55f29129-5acc-42f5-88e8-eb807bac8192'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:51 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:51 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:51 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f" returned: 0 in 0.402s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:51 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc Jul 16 11:09:51 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] Creating offline snapshot 3d047730-0192-4d91-9f60-57fba330792b of volume ce63134b-b39f-4714-be48-084b793cd590 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af2b25-e64a-4553-9aeb-5f60ba51555f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:51 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.332s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:51 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Deleted volume successfully. Jul 16 11:09:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-36bec74d-d3c1-434d-a8b1-bb7529b6f5fd tempest-VolumesDeleteCascade-1342360920 None] Lock "cinder-4cf6fd0f-c386-4de5-b67a-ff3fbf68a606-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:51 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 Jul 16 11:09:51 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:52 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc" returned: 0 in 0.398s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:52 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc Jul 16 11:09:52 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:52 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590" returned: 0 in 0.422s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:52 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b 1G Jul 16 11:09:52 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:52 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f.635e8963-7c5c-4f9d-a5b4-ed11cff680dc" returned: 0 in 0.267s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-635e8963-7c5c-4f9d-a5b4-ed11cff680dc" released by "_delete_snapshot" :: held 1.536s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-ffa0dc49-1719-48d5-a727-e62a2835f07f" released by "delete_snapshot" :: held 1.562s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-c96ac102-a241-4d98-89cf-63d4a956a2eb" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-c96ac102-a241-4d98-89cf-63d4a956a2eb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-d933e2fe-bd89-4c4f-9157-1e4ece21c9f1" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-d933e2fe-bd89-4c4f-9157-1e4ece21c9f1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Deleting offline snapshot d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 of volume c96ac102-a241-4d98-89cf-63d4a956a2eb {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] snapshot_file for this snap is: volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa762b1a-5eaf-41f4-9552-9f837842afa6]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:52 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 Jul 16 11:09:52 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:52 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b 1G" returned: 0 in 0.443s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce63134b-b39f-4714-be48-084b793cd590 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:52 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce63134b-b39f-4714-be48-084b793cd590 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b Jul 16 11:09:52 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:52 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1" returned: 0 in 0.413s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c96ac102-a241-4d98-89cf-63d4a956a2eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed2175f-8620-474b-87ac-aa94b439accd]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:52 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce63134b-b39f-4714-be48-084b793cd590 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b" returned: 0 in 0.349s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:52 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b is being set with open permissions: ugo+rw Jul 16 11:09:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:53 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b Jul 16 11:09:53 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:53 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb Jul 16 11:09:53 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:53 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b" returned: 0 in 0.298s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:53 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb" returned: 0 in 0.417s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:53 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 Jul 16 11:09:53 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:53 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.info Jul 16 11:09:53 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:53 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.info" returned: 0 in 0.293s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:53 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.info is being set with open permissions: ugo+rw Jul 16 11:09:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:53 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.info Jul 16 11:09:53 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:53 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1" returned: 0 in 0.418s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:53 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1 Jul 16 11:09:53 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:53 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.info" returned: 0 in 0.281s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:53 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8934a9ad-6c46-4689-b175-b76211229d0e tempest-VolumeDependencyTests-1186433838 None] Create snapshot completed successfully Jul 16 11:09:54 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb.d933e2fe-bd89-4c4f-9157-1e4ece21c9f1" returned: 0 in 0.260s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-d933e2fe-bd89-4c4f-9157-1e4ece21c9f1" released by "_delete_snapshot" :: held 1.617s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-c96ac102-a241-4d98-89cf-63d4a956a2eb" released by "delete_snapshot" :: held 1.638s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:54 devstack cinder-volume[87345]: WARNING cinder.quota [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-757225660 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-757225660, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:09:54 devstack cinder-volume[87345]: WARNING cinder.quota [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-757225660 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-757225660, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:09:54 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['6ec9d975-1347-4d9a-8be5-ec1701dfab34', '59d40eda-3881-4110-be6f-652261d9a961', '5ca845ba-f357-4568-a33f-e40f62763acd', '16fd6d4d-94b9-4b38-aca5-73a4a1020ab9'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:54 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['1f46c030-7781-4925-b49b-43a36563917c', '0f785916-ed42-4d11-86a5-4c63665c93d7', '48403345-ed4b-4618-a0de-3c610995a892', 'f4a452c1-61e3-4931-a34a-4cf7da2cf938'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:54 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4de2997a-7841-4223-9383-163f5837a7a6 tempest-GroupSnapshotsTest-1630222017 None] group_snapshot be0646ea-498f-4a39-b528-729984ee3614: deleted successfully Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Flow 'volume_create_manager' (9291b6e7-b6bb-43f8-a1cd-295b7ba6887c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2723b690-4630-464a-9aae-d582e535cd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2723b690-4630-464a-9aae-d582e535cd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-781507624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303993a4-f7c7-44f0-b220-778bc530f3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d739ec39bd3b4972aacaf8320e6d64e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3d047730-0192-4d91-9f60-57fba330792b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:55Z,use_quota=True,user_id='3ea53639eb2d418182c785fa6656f917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09862b5-d8b2-4ad0-a08f-0129137a9254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09862b5-d8b2-4ad0-a08f-0129137a9254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799d0d5b-8f61-4612-9a34-9cbfe5bf2d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799d0d5b-8f61-4612-9a34-9cbfe5bf2d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '303993a4-f7c7-44f0-b220-778bc530f3d7', 'volume_name': 'volume-303993a4-f7c7-44f0-b220-778bc530f3d7', 'volume_size': 1, 'snapshot_id': '3d047730-0192-4d91-9f60-57fba330792b'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569ba629-5130-4350-a263-3a73d28611f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569ba629-5130-4350-a263-3a73d28611f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94510fd-75e8-4bc9-9828-95691139aab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:55 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Volume 303993a4-f7c7-44f0-b220-778bc530f3d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-303993a4-f7c7-44f0-b220-778bc530f3d7', 'volume_size': 1, 'snapshot_id': '3d047730-0192-4d91-9f60-57fba330792b'} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "cinder-quobyte-3d047730-0192-4d91-9f60-57fba330792b-303993a4-f7c7-44f0-b220-778bc530f3d7" by "_create_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-3d047730-0192-4d91-9f60-57fba330792b-303993a4-f7c7-44f0-b220-778bc530f3d7" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Creating volume 303993a4-f7c7-44f0-b220-778bc530f3d7 from snapshot 3d047730-0192-4d91-9f60-57fba330792b {{(pid=87345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "cinder-quobyte-303993a4-f7c7-44f0-b220-778bc530f3d7" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-303993a4-f7c7-44f0-b220-778bc530f3d7" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] snapshot: 3d047730-0192-4d91-9f60-57fba330792b, volume: 303993a4-f7c7-44f0-b220-778bc530f3d7, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffe99b7-e0d2-4980-9506-e5221fb7621d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-c96ac102-a241-4d98-89cf-63d4a956a2eb" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-c96ac102-a241-4d98-89cf-63d4a956a2eb" acquired by "delete_volume" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:55 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b Jul 16 11:09:55 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e08362-e55e-4b96-a652-a7d47e4081a7]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:55 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb Jul 16 11:09:55 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:56 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b" returned: 0 in 0.416s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce63134b-b39f-4714-be48-084b793cd590(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b9bc00-e52d-477b-bcc4-416c8b1cfcef]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:56 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 Jul 16 11:09:56 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:56 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb" returned: 0 in 0.398s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:56 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb Jul 16 11:09:56 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:56 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c96ac102-a241-4d98-89cf-63d4a956a2eb" returned: 0 in 0.283s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:56 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590" returned: 0 in 0.434s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7 not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-c96ac102-a241-4d98-89cf-63d4a956a2eb" released by "delete_volume" :: held 0.781s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-ffa0dc49-1719-48d5-a727-e62a2835f07f" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:09:56 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7 Jul 16 11:09:56 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-ffa0dc49-1719-48d5-a727-e62a2835f07f" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Flow 'volume_create_manager' (7b25bc4f-5255-49b3-90df-1aa6959fcedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac349a3-5b06-42ef-bf7a-4ed8ebd16e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db41c01-6be0-4eb1-a0da-834b4b68484c]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac349a3-5b06-42ef-bf7a-4ed8ebd16e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1115044337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b40e17-2ece-494b-a5cb-14d4d0a5ea38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e967b320971d41eb8dbac4d777325136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:56Z,use_quota=True,user_id='0c4e7e1b48df42eeb8eb5ca43d723d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384a528b-8fe9-4c44-987c-18e83b9e97a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384a528b-8fe9-4c44-987c-18e83b9e97a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e8c339-cfe0-46ba-bea5-9f029de06d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e8c339-cfe0-46ba-bea5-9f029de06d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b40e17-2ece-494b-a5cb-14d4d0a5ea38', 'volume_name': 'volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47a9a81-ac0a-4cfe-9178-f71fe7a5ade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47a9a81-ac0a-4cfe-9178-f71fe7a5ade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be61f11b-02f0-4150-bb4e-dfc6969eb004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:09:56 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Volume d2b40e17-2ece-494b-a5cb-14d4d0a5ea38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38', 'volume_size': 1} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:56 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f Jul 16 11:09:56 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:56 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f" returned: 0 in 0.379s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:57 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f Jul 16 11:09:57 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:57 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ffa0dc49-1719-48d5-a727-e62a2835f07f" returned: 0 in 0.322s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-ffa0dc49-1719-48d5-a727-e62a2835f07f" released by "delete_volume" :: held 0.821s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:09:57 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['879aecff-a818-4555-b26d-1a6aa4cc3b17'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:57 devstack cinder-volume[87345]: WARNING cinder.quota [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-757225660 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-757225660, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:09:57 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['786d2c83-a8b6-43d4-bfd7-f65b6382a938', '43c71cd6-d5a0-493c-a1df-a5769a40e7a1', '76c1947a-ea71-4ee7-9712-572c4b560e44', 'fa976154-b951-47b9-bdb5-7a532a8d3425'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:57 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['33f585d0-0900-4713-948a-6103221edb6f', '0e9ced4d-50de-4373-ab1e-96367662260c', 'c2815178-32bd-457d-88ff-c0e07e6f9e28', '90cea573-76d4-458e-b834-2abae0a1ee79'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:09:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:09:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:09:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:09:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:09:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:09:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:09:58 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:09:58 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:09:58 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 16 11:09:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.478s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:09:58 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:09:58 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d3b6ea64-1783-47c7-badd-918811de81cb tempest-GroupSnapshotsTest-1630222017 None] Delete group completed successfully. Jul 16 11:09:59 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e54add04-2626-4220-a4ab-9767748ce93c tempest-GroupSnapshotsTest-1630222017 None] Group tempest-GroupSnapshotsTest-Group-743571515: creating Jul 16 11:09:59 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e54add04-2626-4220-a4ab-9767748ce93c tempest-GroupSnapshotsTest-1630222017 None] Group tempest-GroupSnapshotsTest-Group-743571515: created successfully Jul 16 11:09:59 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e54add04-2626-4220-a4ab-9767748ce93c tempest-GroupSnapshotsTest-1630222017 None] Create group completed successfully. Jul 16 11:10:01 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7" returned: 0 in 4.756s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9408d30-44dd-4fa9-8011-b723db5917a7]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=206,cinder:INSERT=60,cinder:UPDATE=210,cinder:DELETE=12 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=233,cinder:SELECT=180,cinder:DELETE=16,cinder:INSERT=45 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Flow 'volume_create_manager' (3d727553-2e65-4faa-bfa8-afd7e195a538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9328721a-ba83-4e16-94cf-367d4113711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9328721a-ba83-4e16-94cf-367d4113711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1346317669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3985270-2e0f-44c8-aa65-3e244b667135,host='devstack@QuobyteHD#QuobyteHD',id=92c4c10f-8d41-4eeb-854c-66ca85972967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfe72a767674079a2e017ef7ecf1dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:01Z,use_quota=True,user_id='b7acbf078e154649b73399b21e2bbf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58022b18-4bb5-45c2-abf4-89efed387a10),volume_type_id=58022b18-4bb5-45c2-abf4-89efed387a10)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:01 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 Jul 16 11:10:01 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410934e1-2730-4fec-9d3d-d7f8b0994ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410934e1-2730-4fec-9d3d-d7f8b0994ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce33964-23ca-4ad2-92e7-a6349b4e9ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce33964-23ca-4ad2-92e7-a6349b4e9ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c4c10f-8d41-4eeb-854c-66ca85972967', 'volume_name': 'volume-92c4c10f-8d41-4eeb-854c-66ca85972967', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479fd47b-803b-4542-be33-c25806cf0f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479fd47b-803b-4542-be33-c25806cf0f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296fc3f8-33dc-4679-9d9b-ec31d39a8cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:01 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Volume 92c4c10f-8d41-4eeb-854c-66ca85972967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c4c10f-8d41-4eeb-854c-66ca85972967', 'volume_size': 1} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:01 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590" returned: 0 in 0.530s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:10:01 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Converted 1024.00 MB image at 215.27 MB/s Jul 16 11:10:01 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7 is being set with open permissions: ugo+rw Jul 16 11:10:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:01 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7 Jul 16 11:10:01 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:02 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7" returned: 0 in 0.233s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-303993a4-f7c7-44f0-b220-778bc530f3d7" released by "_copy_volume_from_snapshot" :: held 6.483s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-3d047730-0192-4d91-9f60-57fba330792b-303993a4-f7c7-44f0-b220-778bc530f3d7" released by "_create_volume_from_snapshot" :: held 6.521s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.538s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.376s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1115044337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b40e17-2ece-494b-a5cb-14d4d0a5ea38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e967b320971d41eb8dbac4d777325136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:09:56Z,use_quota=True,user_id='0c4e7e1b48df42eeb8eb5ca43d723d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Creating volume d2b40e17-2ece-494b-a5cb-14d4d0a5ea38 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:10:02 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:02 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38 1073741824 Jul 16 11:10:02 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94510fd-75e8-4bc9-9828-95691139aab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303993a4-f7c7-44f0-b220-778bc530f3d7', 'volume_size': 1, 'snapshot_id': '3d047730-0192-4d91-9f60-57fba330792b'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90aea5bc-e6e1-4f24-990b-8c39bf01dc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:02 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Volume volume-303993a4-f7c7-44f0-b220-778bc530f3d7 (303993a4-f7c7-44f0-b220-778bc530f3d7): created successfully Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90aea5bc-e6e1-4f24-990b-8c39bf01dc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Flow 'volume_create_manager' (9291b6e7-b6bb-43f8-a1cd-295b7ba6887c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:02 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7c55d902-320d-4b43-b0c3-02d923f18237 tempest-VolumeDependencyTests-1186433838 None] Created volume successfully. Jul 16 11:10:02 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38 1073741824" returned: 0 in 0.410s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:02 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38 Jul 16 11:10:02 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:02 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38" returned: 0 in 0.236s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.305s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3985270-2e0f-44c8-aa65-3e244b667135,created_at=2026-07-16T09:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1346317669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3985270-2e0f-44c8-aa65-3e244b667135,host='devstack@QuobyteHD#QuobyteHD',id=92c4c10f-8d41-4eeb-854c-66ca85972967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfe72a767674079a2e017ef7ecf1dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:01Z,use_quota=True,user_id='b7acbf078e154649b73399b21e2bbf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58022b18-4bb5-45c2-abf4-89efed387a10),volume_type_id=58022b18-4bb5-45c2-abf4-89efed387a10)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Creating volume 92c4c10f-8d41-4eeb-854c-66ca85972967 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:10:02 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be61f11b-02f0-4150-bb4e-dfc6969eb004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:02 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 1073741824 Jul 16 11:10:02 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e0e4e7-ab76-4d82-abd7-8ad49488ec7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:02 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Volume volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38 (d2b40e17-2ece-494b-a5cb-14d4d0a5ea38): created successfully Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e0e4e7-ab76-4d82-abd7-8ad49488ec7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Flow 'volume_create_manager' (7b25bc4f-5255-49b3-90df-1aa6959fcedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:02 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-1c95f53f-f95f-4afb-9828-cb7a3d8c0b7e tempest-VolumesTransfersV355Test-1203261645 None] Created volume successfully. Jul 16 11:10:03 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 1073741824" returned: 0 in 0.421s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "cinder-3d047730-0192-4d91-9f60-57fba330792b-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:03 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 Jul 16 11:10:03 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-3d047730-0192-4d91-9f60-57fba330792b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "cinder-quobyte-ce63134b-b39f-4714-be48-084b793cd590" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-ce63134b-b39f-4714-be48-084b793cd590" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "cinder-quobyte-3d047730-0192-4d91-9f60-57fba330792b" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-3d047730-0192-4d91-9f60-57fba330792b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Deleting offline snapshot 3d047730-0192-4d91-9f60-57fba330792b of volume ce63134b-b39f-4714-be48-084b793cd590 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] snapshot_file for this snap is: volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69d75b5-8722-41ad-a6de-6ac049859ae1]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:03 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b Jul 16 11:10:03 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:03 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967" returned: 0 in 0.277s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296fc3f8-33dc-4679-9d9b-ec31d39a8cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c4c10f-8d41-4eeb-854c-66ca85972967', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188b5275-17b5-47c0-a580-d15f8418dff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:03 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Volume volume-92c4c10f-8d41-4eeb-854c-66ca85972967 (92c4c10f-8d41-4eeb-854c-66ca85972967): created successfully Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188b5275-17b5-47c0-a580-d15f8418dff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Flow 'volume_create_manager' (3d727553-2e65-4faa-bfa8-afd7e195a538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:03 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d6939838-db52-4582-843f-e4572597a86f tempest-GroupSnapshotsTest-1630222017 None] Created volume successfully. Jul 16 11:10:03 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b" returned: 0 in 0.382s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce63134b-b39f-4714-be48-084b793cd590(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64e03eb-53f4-4a1b-b577-e4fef84b3024]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:03 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 Jul 16 11:10:03 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:03 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] GroupSnapshot 9a68d477-af1d-4c0a-ba54-5180ee8e6655: creating. Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] Group snapshot 9a68d477-af1d-4c0a-ba54-5180ee8e6655: creating. {{(pid=87345) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] Creating offline snapshot 5b105666-b812-44d2-b767-a18c0bd961b6 of volume 92c4c10f-8d41-4eeb-854c-66ca85972967 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:10:03 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[42125bd6-2846-4e03-9b1e-d9d75097ea45]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:04 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e4193229-aad6-4a16-9d89-f4ff0e86a4a2 tempest-VolumesTransfersV355Test-567428206 None] Transfer volume completed successfully. Jul 16 11:10:04 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 Jul 16 11:10:04 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:04 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590" returned: 0 in 0.405s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:04 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b Jul 16 11:10:04 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:04 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967" returned: 0 in 0.411s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:04 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 1G Jul 16 11:10:04 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Acquiring lock "cinder-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Lock "cinder-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Acquiring lock "cinder-quobyte-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Lock "cinder-quobyte-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:04 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b" returned: 0 in 0.422s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[184850cd-5ceb-4ed7-a99f-cead1ba6aeb5]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:04 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b Jul 16 11:10:04 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:04 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38 Jul 16 11:10:04 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:04 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 1G" returned: 0 in 0.411s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c4c10f-8d41-4eeb-854c-66ca85972967 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:04 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c4c10f-8d41-4eeb-854c-66ca85972967 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 Jul 16 11:10:04 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:04 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590.3d047730-0192-4d91-9f60-57fba330792b" returned: 0 in 0.292s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-3d047730-0192-4d91-9f60-57fba330792b" released by "_delete_snapshot" :: held 1.628s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-ce63134b-b39f-4714-be48-084b793cd590" released by "delete_snapshot" :: held 1.667s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:04 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38" returned: 0 in 0.381s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:05 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38 Jul 16 11:10:05 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Created reservations ['f1bb2446-020e-458b-a137-5b4775cc3bd1', '3e628303-035b-4f1d-b50c-0060ac81c392', '8d0858b4-ef6f-4e1c-8b09-2865a7819b1c', '37b5770b-1403-4ee2-b803-35d810726457'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:05 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Delete snapshot completed successfully. Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4087b960-b191-4321-a27c-dfc0f766b015 tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-3d047730-0192-4d91-9f60-57fba330792b-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:05 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c4c10f-8d41-4eeb-854c-66ca85972967 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6" returned: 0 in 0.329s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:05 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:05 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 Jul 16 11:10:05 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:05 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38" returned: 0 in 0.263s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Lock "cinder-quobyte-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38" released by "delete_volume" :: held 0.694s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Created reservations ['9ae1d61b-eabf-4ffc-9310-b08220c1c7c6', '31c59777-ef4c-401c-8c91-0bd120d518f2', '68140e3c-1c19-4a7d-baea-86fa823d4cb8', 'a602ad39-f730-4aa6-b4dc-d19d7936204a'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "cinder-ce63134b-b39f-4714-be48-084b793cd590-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:05 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:05 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6" returned: 0 in 0.280s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:05 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-ce63134b-b39f-4714-be48-084b793cd590-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "cinder-quobyte-ce63134b-b39f-4714-be48-084b793cd590" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:05 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.info Jul 16 11:10:05 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-ce63134b-b39f-4714-be48-084b793cd590" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdb2d60-8201-4905-aefc-92b2ef3878d3]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:05 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 Jul 16 11:10:05 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:05 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.290s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:05 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Deleted volume successfully. Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-03546c35-3c52-41b5-9df1-6409eb98d1ec tempest-VolumesTransfersV355Test-1564903650 None] Lock "cinder-d2b40e17-2ece-494b-a5cb-14d4d0a5ea38-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:05 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.info" returned: 0 in 0.326s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:05 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:05 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.info Jul 16 11:10:05 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:05 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590" returned: 0 in 0.420s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:06 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590 Jul 16 11:10:06 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:06 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.info" returned: 0 in 0.272s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:06 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b7562a46-2a72-4243-9fd5-b596298187a9 tempest-GroupSnapshotsTest-1630222017 None] group_snapshot 9a68d477-af1d-4c0a-ba54-5180ee8e6655: created successfully Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Flow 'volume_create_manager' (134ebc6a-cac3-44d2-8c33-d0c681b9a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c17c09-338a-47f8-8f92-c9faf5e7d925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c17c09-338a-47f8-8f92-c9faf5e7d925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1633365004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d547b4a-07c4-4645-87bb-bcac76040c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e967b320971d41eb8dbac4d777325136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:06Z,use_quota=True,user_id='0c4e7e1b48df42eeb8eb5ca43d723d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222c68b6-c22e-40df-a29f-b6395c992900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222c68b6-c22e-40df-a29f-b6395c992900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73d4921-282b-45b6-a6cd-ed72e53fc5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73d4921-282b-45b6-a6cd-ed72e53fc5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d547b4a-07c4-4645-87bb-bcac76040c03', 'volume_name': 'volume-7d547b4a-07c4-4645-87bb-bcac76040c03', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410e01df-b33c-41e7-bd4f-21339d1c7149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410e01df-b33c-41e7-bd4f-21339d1c7149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fe19f0-cdb5-4fcd-b3de-bcfbcd4e7039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:06 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Volume 7d547b4a-07c4-4645-87bb-bcac76040c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d547b4a-07c4-4645-87bb-bcac76040c03', 'volume_size': 1} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:06 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1633365004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d547b4a-07c4-4645-87bb-bcac76040c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e967b320971d41eb8dbac4d777325136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:06Z,use_quota=True,user_id='0c4e7e1b48df42eeb8eb5ca43d723d35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Creating volume 7d547b4a-07c4-4645-87bb-bcac76040c03 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:10:06 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ce63134b-b39f-4714-be48-084b793cd590" returned: 0 in 0.310s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:06 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03 1073741824 Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-ce63134b-b39f-4714-be48-084b793cd590" released by "delete_volume" :: held 0.792s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:06 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Created reservations ['92802a6a-a657-400d-aa85-4ceabf74f5f7', '3175cf50-968a-49ad-a574-fb29bebeec2f', '255cfede-070c-48f7-930b-8de028505201', '65b08c5e-30f1-4b9a-b1c2-9e56720f5c36'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:06 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:06 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "cinder-303993a4-f7c7-44f0-b220-778bc530f3d7-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-303993a4-f7c7-44f0-b220-778bc530f3d7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "cinder-quobyte-303993a4-f7c7-44f0-b220-778bc530f3d7" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-303993a4-f7c7-44f0-b220-778bc530f3d7" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:06 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.284s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:06 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Deleted volume successfully. Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcabd231-df59-4623-b9ef-3a0773a7619b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de327c9b-998d-4639-bc6c-01f1c7fe7add tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-ce63134b-b39f-4714-be48-084b793cd590-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:06 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03 1073741824" returned: 0 in 0.493s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:06 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7 Jul 16 11:10:06 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:06 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03 Jul 16 11:10:06 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:07 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fe19f0-cdb5-4fcd-b3de-bcfbcd4e7039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d547b4a-07c4-4645-87bb-bcac76040c03', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:07 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbda476-e76a-40cc-a15e-2ea153fb9097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7" returned: 0 in 0.366s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Volume volume-7d547b4a-07c4-4645-87bb-bcac76040c03 (7d547b4a-07c4-4645-87bb-bcac76040c03): created successfully Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbda476-e76a-40cc-a15e-2ea153fb9097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:07 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7 Jul 16 11:10:07 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Flow 'volume_create_manager' (134ebc6a-cac3-44d2-8c33-d0c681b9a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:07 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c84a9691-9b8e-489f-ad4b-4eaf4ea36643 tempest-VolumesTransfersV355Test-1203261645 None] Created volume successfully. Jul 16 11:10:07 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] group_snapshot 9a68d477-af1d-4c0a-ba54-5180ee8e6655: deleting Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] group_snapshot 9a68d477-af1d-4c0a-ba54-5180ee8e6655: deleting {{(pid=87345) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 11:10:07 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-92c4c10f-8d41-4eeb-854c-66ca85972967" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303993a4-f7c7-44f0-b220-778bc530f3d7" returned: 0 in 0.302s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-quobyte-303993a4-f7c7-44f0-b220-778bc530f3d7" released by "delete_volume" :: held 0.727s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-92c4c10f-8d41-4eeb-854c-66ca85972967" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-5b105666-b812-44d2-b767-a18c0bd961b6" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-5b105666-b812-44d2-b767-a18c0bd961b6" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Deleting offline snapshot 5b105666-b812-44d2-b767-a18c0bd961b6 of volume 92c4c10f-8d41-4eeb-854c-66ca85972967 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] snapshot_file for this snap is: volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afe9940-356d-4307-9cf4-17d5dfedd9f0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Created reservations ['405b006b-1299-4910-9f9a-13954cf060e0', 'b9c6a533-d28c-4861-b4c7-df02b7dfbe01', '2cbe1b4a-f9c0-4703-b2aa-2deb43036a7f', '66585cdf-4a93-4f8e-b8a7-3a3d9f7862a3'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Acquiring lock "cinder-7d547b4a-07c4-4645-87bb-bcac76040c03-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Lock "cinder-7d547b4a-07c4-4645-87bb-bcac76040c03-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:07 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 Jul 16 11:10:07 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Acquiring lock "cinder-quobyte-7d547b4a-07c4-4645-87bb-bcac76040c03" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:07 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:07 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Lock "cinder-quobyte-7d547b4a-07c4-4645-87bb-bcac76040c03" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a73445-b230-4130-971b-1373f66a095a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:07 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03 Jul 16 11:10:07 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:07 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.268s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:07 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Deleted volume successfully. Jul 16 11:10:07 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6" returned: 0 in 0.440s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c4c10f-8d41-4eeb-854c-66ca85972967(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a9e2743c-17d7-4532-832b-731d25a7e1ed tempest-VolumeDependencyTests-1186433838 None] Lock "cinder-303993a4-f7c7-44f0-b220-778bc530f3d7-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8f7612-f5d9-4c32-9df1-042dbc637e7f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:08 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 Jul 16 11:10:08 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:08 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03" returned: 0 in 0.409s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:08 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03 Jul 16 11:10:08 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:08 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967" returned: 0 in 0.402s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:08 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7d547b4a-07c4-4645-87bb-bcac76040c03" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Lock "cinder-quobyte-7d547b4a-07c4-4645-87bb-bcac76040c03" released by "delete_volume" :: held 0.721s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:08 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 Jul 16 11:10:08 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Created reservations ['82d5fecb-e957-48a5-af13-98b524a27bd2', '560cf27b-59b1-43d7-b944-160564aa5759', '4b3cb869-f556-49a6-992d-dacd0d7c1c92', '56e27aae-f088-4a35-acdd-99e7b59f4ccc'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:08 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:08 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:08 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6" returned: 0 in 0.418s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:08 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6 Jul 16 11:10:08 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:08 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.337s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:08 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Deleted volume successfully. Jul 16 11:10:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-265ad4a3-332a-4ee2-b596-8aeca20f4608 tempest-VolumesTransfersV355Test-1564903650 None] Lock "cinder-7d547b4a-07c4-4645-87bb-bcac76040c03-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:09 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967.5b105666-b812-44d2-b767-a18c0bd961b6" returned: 0 in 0.295s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-5b105666-b812-44d2-b767-a18c0bd961b6" released by "_delete_snapshot" :: held 1.692s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-92c4c10f-8d41-4eeb-854c-66ca85972967" released by "delete_snapshot" :: held 1.738s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:09 devstack cinder-volume[87345]: WARNING cinder.quota [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-891474040 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-891474040, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:10:09 devstack cinder-volume[87345]: WARNING cinder.quota [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-891474040 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-891474040, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:10:09 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['b59c51f2-78cc-4e81-983c-00d2b5016d47', 'cf04005a-0558-4c25-acb5-546499b605b3', 'c47c4816-658e-4587-8801-ffcdbf8caea2', 'b59c5a53-63db-4456-a8da-e5edb6f9eb9f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-492cbf36-701e-4dc6-9878-32395da31449 tempest-GroupSnapshotsTest-1630222017 None] group_snapshot 9a68d477-af1d-4c0a-ba54-5180ee8e6655: deleted successfully Jul 16 11:10:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "cinder-quobyte-92c4c10f-8d41-4eeb-854c-66ca85972967" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-92c4c10f-8d41-4eeb-854c-66ca85972967" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34eb50b-1dbd-421f-9876-39de169a0940]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:10 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 Jul 16 11:10:10 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:10 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967" returned: 0 in 0.412s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:10 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967 Jul 16 11:10:10 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:10 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-92c4c10f-8d41-4eeb-854c-66ca85972967" returned: 0 in 0.282s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Lock "cinder-quobyte-92c4c10f-8d41-4eeb-854c-66ca85972967" released by "delete_volume" :: held 0.769s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['5d1e4d1f-afcf-447d-81dc-08ed374a3af5'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:10 devstack cinder-volume[87345]: WARNING cinder.quota [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-891474040 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-891474040, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Created reservations ['525c3e8f-4f47-44f6-a8aa-dd6d5e62e494', 'ec0a2070-dfd1-4a13-80a3-2fee782952c2', 'd02330be-0deb-457d-8d5c-b857fc9c75eb', 'ba352620-d04c-4f7b-82ab-9e72d4a0fb5d'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:11 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:11 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:11 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.281s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:11 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:11 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-0e229641-2e2e-4412-bea8-f0b544b811f4 tempest-GroupSnapshotsTest-1630222017 None] Delete group completed successfully. Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Flow 'volume_create_manager' (2025da1e-f125-451f-b3d6-d9d3184b2670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeaf302-9fe1-46df-9f23-2ba27cf7376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeaf302-9fe1-46df-9f23-2ba27cf7376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1993840445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc74df6-0645-4e9a-a537-561690812ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e06f2624a0491c9175ecd7b4d74f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:12Z,use_quota=True,user_id='995c96da2f8f4686bc3779eab237be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f313d979-ba18-4ab7-a1b0-12425d25b211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f313d979-ba18-4ab7-a1b0-12425d25b211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760c39f4-04e8-49d4-81c8-efe3e0633373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760c39f4-04e8-49d4-81c8-efe3e0633373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc74df6-0645-4e9a-a537-561690812ef0', 'volume_name': 'volume-9fc74df6-0645-4e9a-a537-561690812ef0', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c2d456-1e0a-413a-b27c-f0104bb0051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c2d456-1e0a-413a-b27c-f0104bb0051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d130df1-49e2-48b8-8c20-d464eacc1aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:12 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Volume 9fc74df6-0645-4e9a-a537-561690812ef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc74df6-0645-4e9a-a537-561690812ef0', 'volume_size': 1} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1993840445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc74df6-0645-4e9a-a537-561690812ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e06f2624a0491c9175ecd7b4d74f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:12Z,use_quota=True,user_id='995c96da2f8f4686bc3779eab237be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Creating volume 9fc74df6-0645-4e9a-a537-561690812ef0 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:10:12 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:12 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0 1073741824 Jul 16 11:10:12 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:12 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0 1073741824" returned: 0 in 0.514s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:12 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0 Jul 16 11:10:12 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:13 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0" returned: 0 in 0.307s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:10:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d130df1-49e2-48b8-8c20-d464eacc1aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc74df6-0645-4e9a-a537-561690812ef0', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208867c1-ec4a-43c9-bdd6-492c993625aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:13 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Volume volume-9fc74df6-0645-4e9a-a537-561690812ef0 (9fc74df6-0645-4e9a-a537-561690812ef0): created successfully Jul 16 11:10:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208867c1-ec4a-43c9-bdd6-492c993625aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Flow 'volume_create_manager' (2025da1e-f125-451f-b3d6-d9d3184b2670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:13 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8f7a6b07-bdd7-4cc8-bc3b-8f83737c5727 tempest-ProjectReaderTests-608346081 None] Created volume successfully. Jul 16 11:10:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Acquiring lock "cinder-9fc74df6-0645-4e9a-a537-561690812ef0-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Lock "cinder-9fc74df6-0645-4e9a-a537-561690812ef0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Acquiring lock "cinder-quobyte-9fc74df6-0645-4e9a-a537-561690812ef0" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Lock "cinder-quobyte-9fc74df6-0645-4e9a-a537-561690812ef0" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:14 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[319abae1-3cd1-4a6a-95e4-1a643f59e06b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:14 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0 Jul 16 11:10:14 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:15 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0" returned: 0 in 0.424s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:15 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0 Jul 16 11:10:15 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:15 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9fc74df6-0645-4e9a-a537-561690812ef0" returned: 0 in 0.311s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Lock "cinder-quobyte-9fc74df6-0645-4e9a-a537-561690812ef0" released by "delete_volume" :: held 0.781s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Created reservations ['c1acbd93-f558-435a-b5b5-5ef54258be6a', '1037dc97-a650-4045-9e13-99d760b1c912', '0fb97185-a376-4aa4-8c7f-1fdea22bb259', 'a85e47d9-7139-41dd-b210-73602f11fb2a'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:15 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:15 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:15 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.260s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Deleted volume successfully. Jul 16 11:10:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fa6c0d9c-3288-4524-93f8-b0012eab3fdf tempest-ProjectReaderTests-608346081 None] Lock "cinder-9fc74df6-0645-4e9a-a537-561690812ef0-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Flow 'volume_create_manager' (f8b8dbe0-6dd6-4d6e-a5e0-7038c42aa51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47cf313e-269d-465e-9881-b10bcd5bc262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47cf313e-269d-465e-9881-b10bcd5bc262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645976086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169b968e-b66e-4c94-8423-496774fd3dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e06f2624a0491c9175ecd7b4d74f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:16Z,use_quota=True,user_id='995c96da2f8f4686bc3779eab237be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c617d2-8484-4340-9f1a-a54c2a08c346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c617d2-8484-4340-9f1a-a54c2a08c346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e727dc18-6c1a-496b-b447-5dcb091392bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e727dc18-6c1a-496b-b447-5dcb091392bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '169b968e-b66e-4c94-8423-496774fd3dc6', 'volume_name': 'volume-169b968e-b66e-4c94-8423-496774fd3dc6', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c408d7a8-1d01-4db3-8e7b-2e012d7301c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c408d7a8-1d01-4db3-8e7b-2e012d7301c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274cba3b-2a62-4348-bcbf-fe2d07bdb1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:16 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Volume 169b968e-b66e-4c94-8423-496774fd3dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-169b968e-b66e-4c94-8423-496774fd3dc6', 'volume_size': 1} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-645976086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169b968e-b66e-4c94-8423-496774fd3dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1e06f2624a0491c9175ecd7b4d74f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:16Z,use_quota=True,user_id='995c96da2f8f4686bc3779eab237be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Creating volume 169b968e-b66e-4c94-8423-496774fd3dc6 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:10:16 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:16 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6 1073741824 Jul 16 11:10:16 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:16 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-81a2f4ec-fd7e-47f4-b829-523ac38be609 tempest-GroupSnapshotsV319Test-1575465756 None] Group tempest-GroupSnapshotsV319Test-Group-1213322075: creating Jul 16 11:10:16 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-81a2f4ec-fd7e-47f4-b829-523ac38be609 tempest-GroupSnapshotsV319Test-1575465756 None] Group tempest-GroupSnapshotsV319Test-Group-1213322075: created successfully Jul 16 11:10:16 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-81a2f4ec-fd7e-47f4-b829-523ac38be609 tempest-GroupSnapshotsV319Test-1575465756 None] Create group completed successfully. Jul 16 11:10:16 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6 1073741824" returned: 0 in 0.460s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:16 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6 Jul 16 11:10:16 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:17 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6" returned: 0 in 0.248s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274cba3b-2a62-4348-bcbf-fe2d07bdb1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169b968e-b66e-4c94-8423-496774fd3dc6', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb95bdb-c4f1-4eb5-b0d8-77f329ab9f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:17 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Volume volume-169b968e-b66e-4c94-8423-496774fd3dc6 (169b968e-b66e-4c94-8423-496774fd3dc6): created successfully Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb95bdb-c4f1-4eb5-b0d8-77f329ab9f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Flow 'volume_create_manager' (f8b8dbe0-6dd6-4d6e-a5e0-7038c42aa51e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7729ce0f-c7fd-4dbc-897e-fce55220392d tempest-ProjectReaderTests-608346081 None] Created volume successfully. Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Acquiring lock "cinder-169b968e-b66e-4c94-8423-496774fd3dc6-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Lock "cinder-169b968e-b66e-4c94-8423-496774fd3dc6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Acquiring lock "cinder-quobyte-169b968e-b66e-4c94-8423-496774fd3dc6" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Lock "cinder-quobyte-169b968e-b66e-4c94-8423-496774fd3dc6" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe41408-ad05-4ff1-82d6-a0b0ef7ca618]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:17 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6 Jul 16 11:10:17 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:17 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6" returned: 0 in 0.378s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:17 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6 Jul 16 11:10:17 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:18 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-169b968e-b66e-4c94-8423-496774fd3dc6" returned: 0 in 0.253s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Lock "cinder-quobyte-169b968e-b66e-4c94-8423-496774fd3dc6" released by "delete_volume" :: held 0.708s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Created reservations ['9f683fa4-153f-4968-9817-47ef5c5bc527', '97a91892-baa2-41da-b88a-1a85c1e75b78', 'efd96456-835d-4085-8fd8-ac076b216a42', '08a6dcc7-f8c2-4c8c-b092-9f3d44347e4c'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:18 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:18 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Flow 'volume_create_manager' (9ebd1e87-1f2e-4c4e-9021-5e35f1f80cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf577e4-0647-43e0-b4d2-d3a8283270e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf577e4-0647-43e0-b4d2-d3a8283270e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-643745568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c12203e-0eb6-4736-bd5f-42e2418b921a,host='devstack@QuobyteHD#QuobyteHD',id=01471b28-eb35-44a2-bf0f-dd82fb1725a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c29f273f1584c66a15748d854d08281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:18Z,use_quota=True,user_id='54a277fe279b476c873a9b8c2adac658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59567981-e3d4-4c23-80da-0c771d6d7fbc),volume_type_id=59567981-e3d4-4c23-80da-0c771d6d7fbc)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46291002-c59d-4762-a23a-19c0635038d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46291002-c59d-4762-a23a-19c0635038d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b076db05-63a5-46c4-aa0e-32efe476cf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b076db05-63a5-46c4-aa0e-32efe476cf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01471b28-eb35-44a2-bf0f-dd82fb1725a4', 'volume_name': 'volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb0745d-c4a8-457c-9aeb-6edbcd4162d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb0745d-c4a8-457c-9aeb-6edbcd4162d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db90a94-4fa7-4840-9dac-ec53ff874ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:18 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Volume 01471b28-eb35-44a2-bf0f-dd82fb1725a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4', 'volume_size': 1} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6c12203e-0eb6-4736-bd5f-42e2418b921a,created_at=2026-07-16T09:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-643745568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c12203e-0eb6-4736-bd5f-42e2418b921a,host='devstack@QuobyteHD#QuobyteHD',id=01471b28-eb35-44a2-bf0f-dd82fb1725a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c29f273f1584c66a15748d854d08281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:18Z,use_quota=True,user_id='54a277fe279b476c873a9b8c2adac658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59567981-e3d4-4c23-80da-0c771d6d7fbc),volume_type_id=59567981-e3d4-4c23-80da-0c771d6d7fbc)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Creating volume 01471b28-eb35-44a2-bf0f-dd82fb1725a4 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:10:18 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:18 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 1073741824 Jul 16 11:10:18 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:18 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.303s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:18 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Deleted volume successfully. Jul 16 11:10:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-381f2fa6-080d-4331-8668-21b171ee55ef tempest-ProjectReaderTests-608346081 None] Lock "cinder-169b968e-b66e-4c94-8423-496774fd3dc6-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:19 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 1073741824" returned: 0 in 0.618s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:19 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 Jul 16 11:10:19 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:19 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4" returned: 0 in 0.329s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:10:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db90a94-4fa7-4840-9dac-ec53ff874ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46c72d6-8123-47a7-a380-b88313b633ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:19 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Volume volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 (01471b28-eb35-44a2-bf0f-dd82fb1725a4): created successfully Jul 16 11:10:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b46c72d6-8123-47a7-a380-b88313b633ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Flow 'volume_create_manager' (9ebd1e87-1f2e-4c4e-9021-5e35f1f80cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:19 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-fcf4f472-ad5d-42d0-84f4-bc1c7da03d34 tempest-GroupSnapshotsV319Test-1575465756 None] Created volume successfully. Jul 16 11:10:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] GroupSnapshot 83f676e5-cece-43a9-afc0-d20b860a5164: creating. Jul 16 11:10:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] Group snapshot 83f676e5-cece-43a9-afc0-d20b860a5164: creating. {{(pid=87345) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 11:10:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] Creating offline snapshot 68bde2df-f5b2-4042-869b-8b646e68860b of volume 01471b28-eb35-44a2-bf0f-dd82fb1725a4 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:10:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cc547c-2a53-45da-9209-42de33ea0c28]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:21 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 Jul 16 11:10:21 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:21 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4" returned: 0 in 0.453s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:21 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b 1G Jul 16 11:10:21 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:21 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b 1G" returned: 0 in 0.497s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:21 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b Jul 16 11:10:21 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:22 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b" returned: 0 in 0.352s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:22 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:10:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:22 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b Jul 16 11:10:22 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:22 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b" returned: 0 in 0.277s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:22 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.info Jul 16 11:10:22 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:22 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.info" returned: 0 in 0.290s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:22 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 11:10:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:22 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.info Jul 16 11:10:22 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:23 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.info" returned: 0 in 0.329s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:23 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4d8735cb-0989-4795-8f1a-1a54a08243da tempest-GroupSnapshotsV319Test-1575465756 None] group_snapshot 83f676e5-cece-43a9-afc0-d20b860a5164: created successfully Jul 16 11:10:24 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] group_snapshot 83f676e5-cece-43a9-afc0-d20b860a5164: deleting Jul 16 11:10:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] group_snapshot 83f676e5-cece-43a9-afc0-d20b860a5164: deleting {{(pid=87345) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 11:10:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Acquiring lock "cinder-quobyte-01471b28-eb35-44a2-bf0f-dd82fb1725a4" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "cinder-quobyte-01471b28-eb35-44a2-bf0f-dd82fb1725a4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Acquiring lock "cinder-quobyte-68bde2df-f5b2-4042-869b-8b646e68860b" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "cinder-quobyte-68bde2df-f5b2-4042-869b-8b646e68860b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Deleting offline snapshot 68bde2df-f5b2-4042-869b-8b646e68860b of volume 01471b28-eb35-44a2-bf0f-dd82fb1725a4 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:10:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] snapshot_file for this snap is: volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:10:24 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f11a9ff-1592-49c9-84f2-8bffa7392a0b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:24 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b Jul 16 11:10:24 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:25 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b" returned: 0 in 0.433s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:10:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e7a5b6-40e0-4172-971a-79be153ce224]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:25 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 Jul 16 11:10:25 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:25 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4" returned: 0 in 0.462s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:25 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b Jul 16 11:10:25 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:26 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b" returned: 0 in 0.436s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:26 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b Jul 16 11:10:26 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:26 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4.68bde2df-f5b2-4042-869b-8b646e68860b" returned: 0 in 0.270s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "cinder-quobyte-68bde2df-f5b2-4042-869b-8b646e68860b" released by "_delete_snapshot" :: held 1.735s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "cinder-quobyte-01471b28-eb35-44a2-bf0f-dd82fb1725a4" released by "delete_snapshot" :: held 1.761s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:26 devstack cinder-volume[87345]: WARNING cinder.quota [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-590979034 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-590979034, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:10:26 devstack cinder-volume[87345]: WARNING cinder.quota [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-590979034 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-590979034, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] Created reservations ['66bc72d9-7d88-4fc3-b98b-4a291ef6d3ad', 'a2ca82cf-13ae-4e3e-87b9-d220887f7911', '4a93293f-7c92-466a-8cd6-ef86a0290b04', '3476b596-7376-40cf-9d83-0bc1d3553c70'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ef5df081-c7d2-4028-8dfb-4339c236e4f2 tempest-GroupSnapshotsV319Test-1575465756 None] group_snapshot 83f676e5-cece-43a9-afc0-d20b860a5164: deleted successfully Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Flow 'volume_create_manager' (4caee876-255f-4e68-943e-47f68351b2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6a184e-d09e-4a6d-a244-505665b0c6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6a184e-d09e-4a6d-a244-505665b0c6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1167786690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7239f31b-e1c8-44cd-a82f-bac09938bb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23deff03c3c84fbbafec553fa65b732a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:27Z,use_quota=True,user_id='b365f60155094fe182ef2df21afde115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca7b4eb-b4db-4fc3-88c2-414768b2fc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca7b4eb-b4db-4fc3-88c2-414768b2fc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad1b0a3-9656-410e-86b2-079e1c9a4737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad1b0a3-9656-410e-86b2-079e1c9a4737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7239f31b-e1c8-44cd-a82f-bac09938bb1d', 'volume_name': 'volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0203be8-51b8-48cf-bd25-7b902fd18fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0203be8-51b8-48cf-bd25-7b902fd18fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0be632c-32ba-4f40-a191-c7cdf40e7fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:26 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Volume 7239f31b-e1c8-44cd-a82f-bac09938bb1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d', 'volume_size': 1} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1167786690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7239f31b-e1c8-44cd-a82f-bac09938bb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23deff03c3c84fbbafec553fa65b732a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:27Z,use_quota=True,user_id='b365f60155094fe182ef2df21afde115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Creating volume 7239f31b-e1c8-44cd-a82f-bac09938bb1d {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:10:26 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:10:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:26 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d 1073741824 Jul 16 11:10:26 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Acquiring lock "cinder-quobyte-01471b28-eb35-44a2-bf0f-dd82fb1725a4" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "cinder-quobyte-01471b28-eb35-44a2-bf0f-dd82fb1725a4" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace863d-f632-4fdb-bf95-de4d342bc52f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:27 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d 1073741824" returned: 0 in 0.450s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:27 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 Jul 16 11:10:27 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:27 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d Jul 16 11:10:27 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:27 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4" returned: 0 in 0.366s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:27 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4 Jul 16 11:10:27 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:27 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0be632c-32ba-4f40-a191-c7cdf40e7fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f45667-c71e-456d-a7f8-cd81310f02b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:27 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Volume volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d (7239f31b-e1c8-44cd-a82f-bac09938bb1d): created successfully Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f45667-c71e-456d-a7f8-cd81310f02b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Flow 'volume_create_manager' (4caee876-255f-4e68-943e-47f68351b2b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:27 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-79de6046-0df7-4a2e-bd7a-b3b9a92543a7 tempest-VolumesActionsTest-801748001 None] Created volume successfully. Jul 16 11:10:27 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-01471b28-eb35-44a2-bf0f-dd82fb1725a4" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "cinder-quobyte-01471b28-eb35-44a2-bf0f-dd82fb1725a4" released by "delete_volume" :: held 0.671s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Created reservations ['a0203185-d699-4514-b3d2-9d48ab2acde8'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:27 devstack cinder-volume[87345]: WARNING cinder.quota [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-590979034 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-590979034, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:10:27 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Created reservations ['c8d3e20f-3318-4b88-892e-4c79ba6d11a1', '2ead0b52-0959-4bc3-8c6f-6bbbf8beab81', '5ab5d2e9-8d66-4283-9233-11c12774e9b4', '41347d73-611a-4701-aa80-38ca5c2a06e3'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:28 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:28 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:28 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:28 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-933a1f0c-a860-40d2-8976-921effa95723 tempest-GroupSnapshotsV319Test-1575465756 None] Delete group completed successfully. Jul 16 11:10:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-dcb6cb87-66b5-4c9f-abd7-368b116a2f43 tempest-GroupsTest-677062351 None] Group tempest-Group1-930469745: creating Jul 16 11:10:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-dcb6cb87-66b5-4c9f-abd7-368b116a2f43 tempest-GroupsTest-677062351 None] Group tempest-Group1-930469745: created successfully Jul 16 11:10:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-dcb6cb87-66b5-4c9f-abd7-368b116a2f43 tempest-GroupsTest-677062351 None] Create group completed successfully. Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:34 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:34 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:34 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.256s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:10:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:10:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-43aaf175-34e4-4dd1-a939-a9a27ba39785 tempest-GroupsTest-677062351 None] Group tempest-Group2-1911694186: creating Jul 16 11:10:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-43aaf175-34e4-4dd1-a939-a9a27ba39785 tempest-GroupsTest-677062351 None] Group tempest-Group2-1911694186: created successfully Jul 16 11:10:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-43aaf175-34e4-4dd1-a939-a9a27ba39785 tempest-GroupsTest-677062351 None] Create group completed successfully. Jul 16 11:10:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e1c7c5e4-c3af-46f5-861e-d856baa56278 tempest-VolumesActionsTest-801748001 None] Acquiring lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d" by "attach_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e1c7c5e4-c3af-46f5-861e-d856baa56278 tempest-VolumesActionsTest-801748001 None] Lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d" acquired by "attach_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e1c7c5e4-c3af-46f5-861e-d856baa56278 tempest-VolumesActionsTest-801748001 None] Attaching volume 7239f31b-e1c8-44cd-a82f-bac09938bb1d to instance afa4c345-ab52-49ff-9be2-112110e7dc95 at mountpoint /dev/vdb on host None. Jul 16 11:10:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e1c7c5e4-c3af-46f5-861e-d856baa56278 tempest-VolumesActionsTest-801748001 None] Attach volume completed successfully. Jul 16 11:10:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e1c7c5e4-c3af-46f5-861e-d856baa56278 tempest-VolumesActionsTest-801748001 None] Lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d" released by "attach_volume" :: held 0.105s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e16d43dd-24d0-4fc0-bc2f-60eb83e74e79 tempest-VolumesActionsTest-801748001 None] Acquiring lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d-detach_volume" by "detach_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e16d43dd-24d0-4fc0-bc2f-60eb83e74e79 tempest-VolumesActionsTest-801748001 None] Lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:36 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e16d43dd-24d0-4fc0-bc2f-60eb83e74e79 tempest-VolumesActionsTest-801748001 None] Detaching volume 7239f31b-e1c8-44cd-a82f-bac09938bb1d from instance afa4c345-ab52-49ff-9be2-112110e7dc95. Jul 16 11:10:36 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e16d43dd-24d0-4fc0-bc2f-60eb83e74e79 tempest-VolumesActionsTest-801748001 None] Detach volume completed successfully. Jul 16 11:10:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e16d43dd-24d0-4fc0-bc2f-60eb83e74e79 tempest-VolumesActionsTest-801748001 None] Lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Flow 'volume_create_manager' (509fec2f-a4cf-4d6e-8fec-309fdf822bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1388db-4e21-40ad-8af8-3a1d85d3f381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1388db-4e21-40ad-8af8-3a1d85d3f381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-755267983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=456b2556-db36-4701-9932-c683ed53e7f8,host='devstack@QuobyteHD#QuobyteHD',id=682dd996-5b9e-4286-b952-47e1378dd8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438112beabb84e12b86d09cdc9fb9e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:37Z,use_quota=True,user_id='4127dfe7c0b44434ad22584c993ad2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa46e2d4-9204-4b65-b1eb-9b7619f7d469),volume_type_id=aa46e2d4-9204-4b65-b1eb-9b7619f7d469)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe03207-9c25-45cf-b3bb-14c8bc86f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe03207-9c25-45cf-b3bb-14c8bc86f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb8fee1-a9f7-47dd-80d1-6feb8d91e97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb8fee1-a9f7-47dd-80d1-6feb8d91e97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '682dd996-5b9e-4286-b952-47e1378dd8b1', 'volume_name': 'volume-682dd996-5b9e-4286-b952-47e1378dd8b1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce85e905-904d-495b-82c0-2dd67e770ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce85e905-904d-495b-82c0-2dd67e770ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7743ef26-d194-4ff9-8f40-3717e03a9b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:37 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Volume 682dd996-5b9e-4286-b952-47e1378dd8b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-682dd996-5b9e-4286-b952-47e1378dd8b1', 'volume_size': 1} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=456b2556-db36-4701-9932-c683ed53e7f8,created_at=2026-07-16T09:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-755267983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=456b2556-db36-4701-9932-c683ed53e7f8,host='devstack@QuobyteHD#QuobyteHD',id=682dd996-5b9e-4286-b952-47e1378dd8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438112beabb84e12b86d09cdc9fb9e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:37Z,use_quota=True,user_id='4127dfe7c0b44434ad22584c993ad2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa46e2d4-9204-4b65-b1eb-9b7619f7d469),volume_type_id=aa46e2d4-9204-4b65-b1eb-9b7619f7d469)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Creating volume 682dd996-5b9e-4286-b952-47e1378dd8b1 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:10:37 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:10:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:37 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1 1073741824 Jul 16 11:10:37 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:38 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1 1073741824" returned: 0 in 0.508s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:38 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1 Jul 16 11:10:38 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:38 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:10:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7743ef26-d194-4ff9-8f40-3717e03a9b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-682dd996-5b9e-4286-b952-47e1378dd8b1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227e37ee-5f57-4ab2-b30b-660314139ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Volume volume-682dd996-5b9e-4286-b952-47e1378dd8b1 (682dd996-5b9e-4286-b952-47e1378dd8b1): created successfully Jul 16 11:10:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227e37ee-5f57-4ab2-b30b-660314139ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Flow 'volume_create_manager' (509fec2f-a4cf-4d6e-8fec-309fdf822bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-47ae73a7-abdb-4015-88b0-562a3a36b64e tempest-GroupsTest-677062351 None] Created volume successfully. Jul 16 11:10:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Acquiring lock "cinder-quobyte-682dd996-5b9e-4286-b952-47e1378dd8b1" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Lock "cinder-quobyte-682dd996-5b9e-4286-b952-47e1378dd8b1" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:39 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0680cd61-7658-4b1f-ba2f-999a8c0a69b6]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:39 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1 Jul 16 11:10:39 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:39 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1" returned: 0 in 0.375s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:39 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1 Jul 16 11:10:39 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:39 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-682dd996-5b9e-4286-b952-47e1378dd8b1" returned: 0 in 0.272s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Lock "cinder-quobyte-682dd996-5b9e-4286-b952-47e1378dd8b1" released by "delete_volume" :: held 0.699s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:39 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Created reservations ['22937851-50c5-4a3b-8c9c-5d6e5eb66c9c'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:39 devstack cinder-volume[87345]: WARNING cinder.quota [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-912608153 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-912608153, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:10:39 devstack cinder-volume[87345]: WARNING cinder.quota [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-912608153 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-912608153, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:10:39 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Created reservations ['67ce64a7-e5d6-4b86-a6c4-d8bab09af162', 'f709603f-d9d6-4dab-aa77-fe3c232828f9', 'e0c411f3-8e03-4cff-b5ff-b045ccbf102d', 'dbbc1853-b964-4f8c-9654-184fb0a1eae1'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:40 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:40 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:40 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.257s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-860bfa1b-b270-4a3d-9b71-737821f73c20 tempest-GroupsTest-677062351 None] Delete group completed successfully. Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-bc0a91b7-2cbd-44e7-97e0-94ca79547aa7 tempest-GroupsTest-677062351 None] Created reservations ['f362d2ef-9942-4b5d-9a12-755f7a3e4b68'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc0a91b7-2cbd-44e7-97e0-94ca79547aa7 tempest-GroupsTest-677062351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc0a91b7-2cbd-44e7-97e0-94ca79547aa7 tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc0a91b7-2cbd-44e7-97e0-94ca79547aa7 tempest-GroupsTest-677062351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc0a91b7-2cbd-44e7-97e0-94ca79547aa7 tempest-GroupsTest-677062351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc0a91b7-2cbd-44e7-97e0-94ca79547aa7 tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc0a91b7-2cbd-44e7-97e0-94ca79547aa7 tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:40 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:40 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:40 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc0a91b7-2cbd-44e7-97e0-94ca79547aa7 tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:40 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bc0a91b7-2cbd-44e7-97e0-94ca79547aa7 tempest-GroupsTest-677062351 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-bc0a91b7-2cbd-44e7-97e0-94ca79547aa7 tempest-GroupsTest-677062351 None] Delete group completed successfully. Jul 16 11:10:42 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b5cbd7b4-9ca1-4598-aa9f-8505cac5a950 tempest-GroupsTest-677062351 None] Group tempest-GroupsTest-Group-1170802591: creating Jul 16 11:10:42 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b5cbd7b4-9ca1-4598-aa9f-8505cac5a950 tempest-GroupsTest-677062351 None] Group tempest-GroupsTest-Group-1170802591: created successfully Jul 16 11:10:42 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b5cbd7b4-9ca1-4598-aa9f-8505cac5a950 tempest-GroupsTest-677062351 None] Create group completed successfully. Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Flow 'volume_create_manager' (b70abe4b-8d81-4c04-bd5b-f7bc024ad246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e538f64-3458-44e7-9631-a047e06cc8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e538f64-3458-44e7-9631-a047e06cc8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-462709630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f44d41b7-4299-41d2-8954-c87eaee5a9a6,host='devstack@QuobyteHD#QuobyteHD',id=8af8b74e-6580-4ec7-8a13-b19bee95665b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438112beabb84e12b86d09cdc9fb9e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:44Z,use_quota=True,user_id='4127dfe7c0b44434ad22584c993ad2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3361f8a1-6275-433a-a348-6fe16034556f),volume_type_id=3361f8a1-6275-433a-a348-6fe16034556f)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f219208b-7854-4347-aeab-3d86b029dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f219208b-7854-4347-aeab-3d86b029dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fb67dd-ac9c-40fe-be65-5af2b7797816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fb67dd-ac9c-40fe-be65-5af2b7797816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af8b74e-6580-4ec7-8a13-b19bee95665b', 'volume_name': 'volume-8af8b74e-6580-4ec7-8a13-b19bee95665b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860f9b0c-928f-49dd-89d7-b850f7b662c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860f9b0c-928f-49dd-89d7-b850f7b662c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f6ec42-4f03-402d-8de3-a1e94af232d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:44 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Volume 8af8b74e-6580-4ec7-8a13-b19bee95665b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af8b74e-6580-4ec7-8a13-b19bee95665b', 'volume_size': 1} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f44d41b7-4299-41d2-8954-c87eaee5a9a6,created_at=2026-07-16T09:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-462709630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f44d41b7-4299-41d2-8954-c87eaee5a9a6,host='devstack@QuobyteHD#QuobyteHD',id=8af8b74e-6580-4ec7-8a13-b19bee95665b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438112beabb84e12b86d09cdc9fb9e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:44Z,use_quota=True,user_id='4127dfe7c0b44434ad22584c993ad2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3361f8a1-6275-433a-a348-6fe16034556f),volume_type_id=3361f8a1-6275-433a-a348-6fe16034556f)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Creating volume 8af8b74e-6580-4ec7-8a13-b19bee95665b {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:10:44 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:10:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:44 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b 1073741824 Jul 16 11:10:44 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:45 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b 1073741824" returned: 0 in 0.825s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:45 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b Jul 16 11:10:45 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:45 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b" returned: 0 in 0.341s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:10:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f6ec42-4f03-402d-8de3-a1e94af232d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af8b74e-6580-4ec7-8a13-b19bee95665b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a62b927-7729-45b7-ae24-0d32930bb597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:45 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Volume volume-8af8b74e-6580-4ec7-8a13-b19bee95665b (8af8b74e-6580-4ec7-8a13-b19bee95665b): created successfully Jul 16 11:10:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a62b927-7729-45b7-ae24-0d32930bb597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Flow 'volume_create_manager' (b70abe4b-8d81-4c04-bd5b-f7bc024ad246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:45 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-fb9753b0-2289-4756-b2ac-ce7d22a2db09 tempest-GroupsTest-677062351 None] Created volume successfully. Jul 16 11:10:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b90db13d-fdaa-4f8e-88e2-d252101b8da6 tempest-VolumesActionsTest-801748001 None] Acquiring lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d" by "attach_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b90db13d-fdaa-4f8e-88e2-d252101b8da6 tempest-VolumesActionsTest-801748001 None] Lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d" acquired by "attach_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:46 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b90db13d-fdaa-4f8e-88e2-d252101b8da6 tempest-VolumesActionsTest-801748001 None] Attaching volume 7239f31b-e1c8-44cd-a82f-bac09938bb1d to instance 5dd27ceb-4ff2-4d2a-acc4-31462841f516 at mountpoint /dev/vdb on host None. Jul 16 11:10:46 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b90db13d-fdaa-4f8e-88e2-d252101b8da6 tempest-VolumesActionsTest-801748001 None] Attach volume completed successfully. Jul 16 11:10:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b90db13d-fdaa-4f8e-88e2-d252101b8da6 tempest-VolumesActionsTest-801748001 None] Lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d" released by "attach_volume" :: held 0.110s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-14646744-0596-4b9b-81f6-e0456380e6e9 tempest-VolumesActionsTest-801748001 None] Acquiring lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d-detach_volume" by "detach_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-14646744-0596-4b9b-81f6-e0456380e6e9 tempest-VolumesActionsTest-801748001 None] Lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:47 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-14646744-0596-4b9b-81f6-e0456380e6e9 tempest-VolumesActionsTest-801748001 None] Detaching volume 7239f31b-e1c8-44cd-a82f-bac09938bb1d from instance 5dd27ceb-4ff2-4d2a-acc4-31462841f516. Jul 16 11:10:47 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-14646744-0596-4b9b-81f6-e0456380e6e9 tempest-VolumesActionsTest-801748001 None] Detach volume completed successfully. Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-14646744-0596-4b9b-81f6-e0456380e6e9 tempest-VolumesActionsTest-801748001 None] Lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Flow 'volume_create_manager' (a1f8fd40-bc9c-4491-8259-e37343a9fa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589d9004-a8d8-40e7-94fc-4b16bfbabed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589d9004-a8d8-40e7-94fc-4b16bfbabed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1558657453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f44d41b7-4299-41d2-8954-c87eaee5a9a6,host='devstack@QuobyteHD#QuobyteHD',id=34c469af-4e3a-440c-a462-05d2e8417b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438112beabb84e12b86d09cdc9fb9e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:47Z,use_quota=True,user_id='4127dfe7c0b44434ad22584c993ad2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3361f8a1-6275-433a-a348-6fe16034556f),volume_type_id=3361f8a1-6275-433a-a348-6fe16034556f)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1981b969-4017-4e2b-9ebb-7a390dbc6570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1981b969-4017-4e2b-9ebb-7a390dbc6570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb044573-ae9f-4fff-8dbf-cfe37e6a3baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb044573-ae9f-4fff-8dbf-cfe37e6a3baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c469af-4e3a-440c-a462-05d2e8417b98', 'volume_name': 'volume-34c469af-4e3a-440c-a462-05d2e8417b98', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a4ab37-2a2e-467d-8dec-50baaf7ba488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a4ab37-2a2e-467d-8dec-50baaf7ba488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c5ed29-b502-490e-a0d3-da0b04834a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:47 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Volume 34c469af-4e3a-440c-a462-05d2e8417b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c469af-4e3a-440c-a462-05d2e8417b98', 'volume_size': 1} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f44d41b7-4299-41d2-8954-c87eaee5a9a6,created_at=2026-07-16T09:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1558657453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f44d41b7-4299-41d2-8954-c87eaee5a9a6,host='devstack@QuobyteHD#QuobyteHD',id=34c469af-4e3a-440c-a462-05d2e8417b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='438112beabb84e12b86d09cdc9fb9e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:10:47Z,use_quota=True,user_id='4127dfe7c0b44434ad22584c993ad2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3361f8a1-6275-433a-a348-6fe16034556f),volume_type_id=3361f8a1-6275-433a-a348-6fe16034556f)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Creating volume 34c469af-4e3a-440c-a462-05d2e8417b98 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:10:47 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:47 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98 1073741824 Jul 16 11:10:47 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:47 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98 1073741824" returned: 0 in 0.531s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:48 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98 Jul 16 11:10:48 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:48 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98" returned: 0 in 0.295s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:48 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:10:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c5ed29-b502-490e-a0d3-da0b04834a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c469af-4e3a-440c-a462-05d2e8417b98', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbf74a3-5fe0-4332-896d-853a972169e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:10:48 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Volume volume-34c469af-4e3a-440c-a462-05d2e8417b98 (34c469af-4e3a-440c-a462-05d2e8417b98): created successfully Jul 16 11:10:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbf74a3-5fe0-4332-896d-853a972169e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:10:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Flow 'volume_create_manager' (a1f8fd40-bc9c-4491-8259-e37343a9fa5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:10:48 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5cef116e-a074-483b-9429-d78704842fa7 tempest-GroupsTest-677062351 None] Created volume successfully. Jul 16 11:10:49 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d59a4128-2c8d-45a0-b92f-1c6586646aa9 tempest-GroupsTest-677062351 None] Update group completed successfully. Jul 16 11:10:51 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-64185c46-79b6-413a-83e1-88c9087e2851 tempest-GroupsTest-677062351 None] Update group completed successfully. Jul 16 11:10:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:51 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[adda47a6-2650-4add-a7a6-0c27ae2acd24]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:51 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d Jul 16 11:10:51 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:51 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d" returned: 0 in 0.348s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:51 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[445ec0fb-ac83-4ec3-8a0f-623bbb2ac892]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:51 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d Jul 16 11:10:51 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:52 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d" returned: 0 in 0.353s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.1a4347db-78e5-4333-b387-d7ffca0bc4fbhal56snv.img {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:52 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.1a4347db-78e5-4333-b387-d7ffca0bc4fbhal56snv.img Jul 16 11:10:52 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Acquiring lock "cinder-quobyte-34c469af-4e3a-440c-a462-05d2e8417b98" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Lock "cinder-quobyte-34c469af-4e3a-440c-a462-05d2e8417b98" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:52 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a4133e-7fed-4753-8507-5ca99731ef14]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:53 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98 Jul 16 11:10:53 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:53 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98" returned: 0 in 0.585s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:53 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98 Jul 16 11:10:53 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:53 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-34c469af-4e3a-440c-a462-05d2e8417b98" returned: 0 in 0.507s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Lock "cinder-quobyte-34c469af-4e3a-440c-a462-05d2e8417b98" released by "delete_volume" :: held 1.182s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Acquiring lock "cinder-quobyte-8af8b74e-6580-4ec7-8a13-b19bee95665b" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:10:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Lock "cinder-quobyte-8af8b74e-6580-4ec7-8a13-b19bee95665b" acquired by "delete_volume" :: waited 0.027s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:10:54 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b60e855-3b37-42b9-84c9-61af3fd1ee8a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:54 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b Jul 16 11:10:54 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:54 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b" returned: 0 in 0.617s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:54 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b Jul 16 11:10:54 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:55 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8af8b74e-6580-4ec7-8a13-b19bee95665b" returned: 0 in 0.537s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Lock "cinder-quobyte-8af8b74e-6580-4ec7-8a13-b19bee95665b" released by "delete_volume" :: held 1.250s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:10:55 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Created reservations ['045c80b3-2669-4c86-8778-ef1b187f8d99'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:55 devstack cinder-volume[87345]: WARNING cinder.quota [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-767568164 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-767568164, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:10:55 devstack cinder-volume[87345]: WARNING cinder.quota [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-767568164 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-767568164, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:10:55 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Created reservations ['4a8f38ee-79f8-48ef-b3d3-5181aaa53f1d', '37e69a58-3fb5-4ddf-a3ff-f4e13a66546b', '6002175a-a5a8-4369-a130-a3461015dfe5', '4914b570-05f8-4bfa-8871-e6db2824158a'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:55 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Created reservations ['98345a87-d5ed-4fe8-af9f-b1745fba4818', '8604b649-6722-46e4-86a1-87af132446f6', '9ca5ac4c-3dba-4ec1-967b-7979a92d7eef', 'a14272be-8192-4f3d-a4da-c086f13fd051'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:10:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:10:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:10:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:10:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:10:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:10:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:55 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:10:55 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:56 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.343s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:56 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:10:56 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b6a8a74e-6a0f-4ec6-be80-8edde821c192 tempest-GroupsTest-677062351 None] Delete group completed successfully. Jul 16 11:10:56 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.1a4347db-78e5-4333-b387-d7ffca0bc4fbhal56snv.img" returned: 0 in 4.530s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:56 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7529f1-5b8f-4607-bca2-b59caa90aa1c]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:10:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:10:56 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d Jul 16 11:10:56 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:10:57 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 16 11:10:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d" returned: 0 in 0.531s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:10:57 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.1a4347db-78e5-4333-b387-d7ffca0bc4fbhal56snv.img {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:10:57 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] Converted 1024.00 MB image at 225.99 MB/s Jul 16 11:10:57 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] 1a4347db-78e5-4333-b387-d7ffca0bc4fb was raw, no need to convert to raw {{(pid=87345) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 16 11:11:05 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=141,cinder:UPDATE=162,cinder:INSERT=40,cinder:DELETE=13 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:11:07 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=169,cinder:DELETE=4,cinder:SELECT=155,cinder:INSERT=37 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:11:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.624s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] Uploaded volume to glance image-id: 1a4347db-78e5-4333-b387-d7ffca0bc4fb. {{(pid=87345) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 16 11:11:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c4315664-501a-4dec-b8aa-8acf4bb6e401 tempest-VolumesActionsTest-801748001 None] Copy volume to image completed successfully. Jul 16 11:11:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:18 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0326a3c7-b16b-4b5c-a164-b3c5f250a008]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:18 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d Jul 16 11:11:18 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:18 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d" returned: 0 in 0.373s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:18 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cf3bbc-c815-4ecb-945a-b2b868065d62]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:19 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d Jul 16 11:11:19 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:19 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d" returned: 0 in 0.376s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:19 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img Jul 16 11:11:19 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:23 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img" returned: 0 in 4.400s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:23 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d05c8e6-0464-49db-af66-67037d3c5589]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:23 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d Jul 16 11:11:23 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:24 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d" returned: 0 in 0.627s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:24 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:11:24 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Converted 1024.00 MB image at 232.66 MB/s Jul 16 11:11:24 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] f20a48fc-4136-455d-ab59-b8c70b2c07d0 was raw, converting to qcow2 {{(pid=87345) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 16 11:11:24 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[57db1b83-fdef-4947-8c76-527644799972]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:24 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img Jul 16 11:11:24 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:24 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img" returned: 0 in 0.313s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:24 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img Jul 16 11:11:24 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:25 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img" returned: 1 in 0.320s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:11:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img /opt/stack/data/cinder/conversion/vol_upload_14p7m9cv {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:25 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img /opt/stack/data/cinder/conversion/vol_upload_14p7m9cv Jul 16 11:11:25 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:25 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img /opt/stack/data/cinder/conversion/vol_upload_14p7m9cv" returned: 0 in 0.273s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:25 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Image conversion details: src /opt/stack/data/cinder/conversion/7239f31b-e1c8-44cd-a82f-bac09938bb1d.temp_image.f20a48fc-4136-455d-ab59-b8c70b2c07d0nrsj7mh8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_14p7m9cv {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:11:25 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 16 11:11:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6f8005-fdac-4545-afdf-b069a86eb45f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_14p7m9cv {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:25 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_14p7m9cv Jul 16 11:11:25 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:25 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_14p7m9cv" returned: 0 in 0.336s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:27 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:11:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.711s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Uploaded volume to glance image-id: f20a48fc-4136-455d-ab59-b8c70b2c07d0. {{(pid=87345) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 16 11:11:27 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-bbef6f84-df48-4984-942b-11eb61f4260a tempest-VolumesActionsTest-801748001 None] Copy volume to image completed successfully. Jul 16 11:11:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Acquiring lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Acquiring lock "cinder-quobyte-7239f31b-e1c8-44cd-a82f-bac09938bb1d" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Lock "cinder-quobyte-7239f31b-e1c8-44cd-a82f-bac09938bb1d" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:28 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[76336b1a-4172-4f43-ae4b-3551c9b4db74]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:28 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d Jul 16 11:11:28 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:29 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d" returned: 0 in 0.358s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:29 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d Jul 16 11:11:29 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:29 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7239f31b-e1c8-44cd-a82f-bac09938bb1d" returned: 0 in 0.245s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Lock "cinder-quobyte-7239f31b-e1c8-44cd-a82f-bac09938bb1d" released by "delete_volume" :: held 0.647s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Created reservations ['e2992626-5f87-4364-a24f-36b04a76df1f', '9f51c1ab-b202-4b04-a852-c753dd662f5e', 'd91e6767-10a7-4991-bdc5-c4c4f759a3fd', '8dfc7b20-67a9-4c41-b680-00b7c535eb2f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:29 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:11:29 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:29 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.301s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:11:29 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Deleted volume successfully. Jul 16 11:11:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-092d4095-46fd-4671-8a57-dfca102491d2 tempest-VolumesActionsTest-801748001 None] Lock "cinder-7239f31b-e1c8-44cd-a82f-bac09938bb1d-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:34 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:11:34 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:34 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.282s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:11:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (c2477416-aee9-4eaa-8985-9f2963f038c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e692d174-3a6b-4332-a942-0927ccf06119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e692d174-3a6b-4332-a942-0927ccf06119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-300949018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73276126-736f-4c37-a125-fd2ff6ed46c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:11:36Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b6dc3a-ba57-4bcd-baac-668a45bcad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b6dc3a-ba57-4bcd-baac-668a45bcad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc34f58-5055-4455-8210-ce23f8a91640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc34f58-5055-4455-8210-ce23f8a91640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73276126-736f-4c37-a125-fd2ff6ed46c0', 'volume_name': 'volume-73276126-736f-4c37-a125-fd2ff6ed46c0', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7867fb1-fd82-42a0-94d9-fb32ded20984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7867fb1-fd82-42a0-94d9-fb32ded20984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bec790-deca-4e12-a45c-67fb0a178f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:36 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Volume 73276126-736f-4c37-a125-fd2ff6ed46c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73276126-736f-4c37-a125-fd2ff6ed46c0', 'volume_size': 1} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-300949018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73276126-736f-4c37-a125-fd2ff6ed46c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:11:36Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Creating volume 73276126-736f-4c37-a125-fd2ff6ed46c0 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:11:36 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:36 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0 1073741824 Jul 16 11:11:36 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:36 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0 1073741824" returned: 0 in 0.470s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:36 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0 Jul 16 11:11:36 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:36 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0" returned: 0 in 0.248s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bec790-deca-4e12-a45c-67fb0a178f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73276126-736f-4c37-a125-fd2ff6ed46c0', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c08127-7c56-445f-8d02-2a3ed6a681f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:36 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Volume volume-73276126-736f-4c37-a125-fd2ff6ed46c0 (73276126-736f-4c37-a125-fd2ff6ed46c0): created successfully Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c08127-7c56-445f-8d02-2a3ed6a681f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (c2477416-aee9-4eaa-8985-9f2963f038c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:36 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a4c76619-3904-483a-b2d4-3e2380819f14 tempest-VolumesGetTest-97582787 None] Created volume successfully. Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (04bcde05-befd-4b6a-b933-998653e58298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ea28cd-4698-4fb7-96c2-9efcab9eb62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ea28cd-4698-4fb7-96c2-9efcab9eb62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:11:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-416968746',display_name='tempest-VolumesGetTest-Volume-2117109752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247c8956-8705-44af-b97d-0b6eecf6c7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:11:38Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cdd225f-37a2-4262-bc77-d36c5f071e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cdd225f-37a2-4262-bc77-d36c5f071e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912dba9b-4581-4bcb-a8ae-2eba17cc9151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912dba9b-4581-4bcb-a8ae-2eba17cc9151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '247c8956-8705-44af-b97d-0b6eecf6c7f1', 'volume_name': 'volume-247c8956-8705-44af-b97d-0b6eecf6c7f1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb20176f-333f-44c2-8025-0b24b324a103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb20176f-333f-44c2-8025-0b24b324a103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb87217-e76b-4a24-8598-2286478825d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:37 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Volume 247c8956-8705-44af-b97d-0b6eecf6c7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-247c8956-8705-44af-b97d-0b6eecf6c7f1', 'volume_size': 1} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:11:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-416968746',display_name='tempest-VolumesGetTest-Volume-2117109752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247c8956-8705-44af-b97d-0b6eecf6c7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:11:38Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Creating volume 247c8956-8705-44af-b97d-0b6eecf6c7f1 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:11:37 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:11:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:37 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1 1073741824 Jul 16 11:11:37 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:38 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1 1073741824" returned: 0 in 0.412s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:38 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1 Jul 16 11:11:38 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:38 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1" returned: 0 in 0.245s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:11:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb87217-e76b-4a24-8598-2286478825d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-247c8956-8705-44af-b97d-0b6eecf6c7f1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369cc0f4-383b-416a-9054-f615232a3909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Volume volume-247c8956-8705-44af-b97d-0b6eecf6c7f1 (247c8956-8705-44af-b97d-0b6eecf6c7f1): created successfully Jul 16 11:11:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369cc0f4-383b-416a-9054-f615232a3909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (04bcde05-befd-4b6a-b933-998653e58298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-22af517c-f53e-4791-905e-acc5ebb163fd tempest-VolumesGetTest-97582787 None] Created volume successfully. Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-247c8956-8705-44af-b97d-0b6eecf6c7f1-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Lock "cinder-247c8956-8705-44af-b97d-0b6eecf6c7f1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-quobyte-247c8956-8705-44af-b97d-0b6eecf6c7f1" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-247c8956-8705-44af-b97d-0b6eecf6c7f1" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4005f291-92ab-48c7-aed3-31cca5459694]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:39 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1 Jul 16 11:11:39 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:39 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1" returned: 0 in 0.391s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:39 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1 Jul 16 11:11:39 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:39 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-247c8956-8705-44af-b97d-0b6eecf6c7f1" returned: 0 in 0.248s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-247c8956-8705-44af-b97d-0b6eecf6c7f1" released by "delete_volume" :: held 0.688s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Created reservations ['9fac66e5-3890-4e56-b245-bc9fb3123f47', '612f0cec-b387-415d-a117-a5b2fa4165be', 'f6ad8546-3e56-48f9-9d54-5dc64f79856c', '7e498d57-5e64-4bf1-b7c3-92666a28288b'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:40 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:11:40 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:40 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.253s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:40 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:11:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Deleted volume successfully. Jul 16 11:11:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38aa8d4c-2cf4-4424-9920-d6306e6b46ed tempest-VolumesGetTest-97582787 None] Lock "cinder-247c8956-8705-44af-b97d-0b6eecf6c7f1-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-73276126-736f-4c37-a125-fd2ff6ed46c0-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Lock "cinder-73276126-736f-4c37-a125-fd2ff6ed46c0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-quobyte-73276126-736f-4c37-a125-fd2ff6ed46c0" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-73276126-736f-4c37-a125-fd2ff6ed46c0" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:40 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b789c341-501c-423a-9800-71b3f2e52247]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:40 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0 Jul 16 11:11:40 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:40 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0" returned: 0 in 0.365s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:40 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0 Jul 16 11:11:40 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:41 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-73276126-736f-4c37-a125-fd2ff6ed46c0" returned: 0 in 0.268s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-73276126-736f-4c37-a125-fd2ff6ed46c0" released by "delete_volume" :: held 0.674s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Created reservations ['06f08d3d-4ea7-46e8-849a-810e5291b581', '26f1d184-09b6-4bc1-b684-eb21908188b6', '271ff073-8dc0-4828-867e-becf1022eff9', '8f9c74bf-ee41-4cf2-8f36-cec7694c7f9d'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:41 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:11:41 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:41 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.301s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:11:41 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Deleted volume successfully. Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c52df50e-55fe-44de-a9eb-4f2879f9cbc8 tempest-VolumesGetTest-97582787 None] Lock "cinder-73276126-736f-4c37-a125-fd2ff6ed46c0-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:11:41 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (1ed4e872-c41a-4c6b-86f2-0e42b3ed90e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4118dcb5-0534-4950-8916-67b78c3a9d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4118dcb5-0534-4950-8916-67b78c3a9d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-596425982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:11:42Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51aea4b2-9177-4904-86e9-fbc5bffa8134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51aea4b2-9177-4904-86e9-fbc5bffa8134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475e983c-9ffa-4a31-b299-f4056625d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475e983c-9ffa-4a31-b299-f4056625d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d', 'volume_name': 'volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ef1e4b-2c9e-4692-a53f-7409f7771671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ef1e4b-2c9e-4692-a53f-7409f7771671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8e537b-d4a1-451c-b814-b4e7f23e7a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:42 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Volume 6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d', 'volume_size': 1} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-596425982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:11:42Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Creating volume 6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:11:42 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:42 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d 1073741824 Jul 16 11:11:42 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:42 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d 1073741824" returned: 0 in 0.465s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:42 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d Jul 16 11:11:42 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:42 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d" returned: 0 in 0.245s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8e537b-d4a1-451c-b814-b4e7f23e7a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df28989e-e749-44da-8bbb-8948ee67cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:42 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Volume volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d (6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d): created successfully Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df28989e-e749-44da-8bbb-8948ee67cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:42 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (1ed4e872-c41a-4c6b-86f2-0e42b3ed90e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:42 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-645de50c-5c8f-42fb-82a7-e8f31ebab222 tempest-VolumesGetTest-97582787 None] Created volume successfully. Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (459beeb7-adab-4356-b613-78837e402b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3391ad41-bdd5-4d63-b88b-ada5547b0ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3391ad41-bdd5-4d63-b88b-ada5547b0ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-811186071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd64b688-30f1-48d0-abb6-1a1afc9de3f9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d,status='creating',terminated_at=None,updated_at=2026-07-16T09:11:43Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2d7a94-13b4-4c81-9859-eefe5c086937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2d7a94-13b4-4c81-9859-eefe5c086937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbaa1d3-ec7b-43df-8f76-91646a215667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcbaa1d3-ec7b-43df-8f76-91646a215667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bd64b688-30f1-48d0-abb6-1a1afc9de3f9', 'volume_name': 'volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9', 'volume_size': 1, 'source_volid': '6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d', 'source_volstatus': 'available'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccde5936-89af-4da2-8f57-90f69316efe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccde5936-89af-4da2-8f57-90f69316efe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d880fce-ac46-47dc-a45f-402bfca67ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:43 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Volume bd64b688-30f1-48d0-abb6-1a1afc9de3f9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9', 'volume_size': 1, 'source_volid': '6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d', 'source_volstatus': 'available'} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:43 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Cloning volume 6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d to volume bd64b688-30f1-48d0-abb6-1a1afc9de3f9 Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Creating offline snapshot d5860ad9-1175-40b6-9e4d-f5248e219870 of volume 6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47f2999-f64b-4574-a5e5-9c24a683b901]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:43 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d Jul 16 11:11:43 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:44 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d" returned: 0 in 0.364s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:44 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 1G Jul 16 11:11:44 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:44 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 1G" returned: 0 in 0.515s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:44 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 Jul 16 11:11:44 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:44 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870" returned: 0 in 0.354s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:44 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 is being set with open permissions: ugo+rw Jul 16 11:11:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:44 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 Jul 16 11:11:44 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:45 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870" returned: 0 in 0.276s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:45 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.info Jul 16 11:11:45 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:45 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.info" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:45 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.info is being set with open permissions: ugo+rw Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:45 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.info Jul 16 11:11:45 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:45 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.info" returned: 0 in 0.261s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-quobyte-bd64b688-30f1-48d0-abb6-1a1afc9de3f9" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-bd64b688-30f1-48d0-abb6-1a1afc9de3f9" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] snapshot: d5860ad9-1175-40b6-9e4d-f5248e219870, volume: bd64b688-30f1-48d0-abb6-1a1afc9de3f9, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d8ced7-b95f-47bb-ad2f-77ac49a9b181]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:45 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 Jul 16 11:11:45 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:46 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870" returned: 0 in 0.365s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:11:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:11:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:11:46 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae28ae40-98bf-4f7a-82ba-87ec27cd03c8]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:46 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d Jul 16 11:11:46 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:46 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d" returned: 0 in 0.368s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:46 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:11:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:46 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 Jul 16 11:11:46 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:51 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9" returned: 0 in 5.178s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:51 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d579cfb5-4295-4f01-94ca-785bd002b57b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:51 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d Jul 16 11:11:51 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:52 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d" returned: 0 in 0.786s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:52 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:11:52 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Converted 1024.00 MB image at 197.71 MB/s Jul 16 11:11:52 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 is being set with open permissions: ugo+rw Jul 16 11:11:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:52 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 Jul 16 11:11:52 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:52 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9" returned: 0 in 0.367s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-bd64b688-30f1-48d0-abb6-1a1afc9de3f9" released by "_copy_volume_from_snapshot" :: held 7.172s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-quobyte-d5860ad9-1175-40b6-9e4d-f5248e219870" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-d5860ad9-1175-40b6-9e4d-f5248e219870" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Deleting offline snapshot d5860ad9-1175-40b6-9e4d-f5248e219870 of volume 6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:11:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] snapshot_file for this snap is: volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:11:53 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e1276e-bd53-4b8f-addb-b9282b24060a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:53 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 Jul 16 11:11:53 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:53 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870" returned: 0 in 0.425s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:11:53 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[88715ced-3b3a-416a-86f9-0052cedc7c77]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:53 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d Jul 16 11:11:53 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:54 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d" returned: 0 in 0.458s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:54 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 Jul 16 11:11:54 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:54 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870" returned: 0 in 0.400s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:54 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870 Jul 16 11:11:54 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:54 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d.d5860ad9-1175-40b6-9e4d-f5248e219870" returned: 0 in 0.261s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-d5860ad9-1175-40b6-9e4d-f5248e219870" released by "_delete_snapshot" :: held 1.690s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.117s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d880fce-ac46-47dc-a45f-402bfca67ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9', 'volume_size': 1, 'source_volid': '6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d', 'source_volstatus': 'available'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1f5528-2bcf-4a0d-af6f-3a932c0001d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:54 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Volume volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 (bd64b688-30f1-48d0-abb6-1a1afc9de3f9): created successfully Jul 16 11:11:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1f5528-2bcf-4a0d-af6f-3a932c0001d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (459beeb7-adab-4356-b613-78837e402b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:54 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5753132a-2820-447c-9faf-7f204c55d087 tempest-VolumesGetTest-97582787 None] Created volume successfully. Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (6789fbae-3b70-49bc-91fa-b808c14fb185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb13557-9784-4263-859f-f6f2cdce70f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb13557-9784-4263-859f-f6f2cdce70f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1151437794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596c221f-c944-48aa-a2c6-90a74fab4217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:11:55Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9879b791-2a74-451c-af05-5b629d9d33f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9879b791-2a74-451c-af05-5b629d9d33f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fb90f4-de0d-433c-8c8a-1adf259b1c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fb90f4-de0d-433c-8c8a-1adf259b1c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596c221f-c944-48aa-a2c6-90a74fab4217', 'volume_name': 'volume-596c221f-c944-48aa-a2c6-90a74fab4217', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5137cb3-47ac-4145-abee-fa5a2d42b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5137cb3-47ac-4145-abee-fa5a2d42b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5408ec72-4397-4822-a282-8b60d1eba355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:55 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Volume 596c221f-c944-48aa-a2c6-90a74fab4217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596c221f-c944-48aa-a2c6-90a74fab4217', 'volume_size': 1} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1151437794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596c221f-c944-48aa-a2c6-90a74fab4217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:11:55Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Creating volume 596c221f-c944-48aa-a2c6-90a74fab4217 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:11:55 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:55 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217 1073741824 Jul 16 11:11:55 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:55 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217 1073741824" returned: 0 in 0.547s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:55 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217 Jul 16 11:11:55 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:56 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217" returned: 0 in 0.281s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5408ec72-4397-4822-a282-8b60d1eba355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596c221f-c944-48aa-a2c6-90a74fab4217', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec0c5ad-81c9-4be9-8a0c-5fee05a223dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:56 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Volume volume-596c221f-c944-48aa-a2c6-90a74fab4217 (596c221f-c944-48aa-a2c6-90a74fab4217): created successfully Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec0c5ad-81c9-4be9-8a0c-5fee05a223dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (6789fbae-3b70-49bc-91fa-b808c14fb185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:56 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-1032c014-ebcd-4c63-babb-41aeca820fbb tempest-VolumesActionsTest-1700251723 None] Created volume successfully. Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (8730bf6b-aafe-4b81-8f78-78ad59b1fc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7e7a8f-ae51-4f12-8df5-8a5a2b179ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7e7a8f-ae51-4f12-8df5-8a5a2b179ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:11:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860498145',display_name='tempest-VolumesGetTest-Volume-1635479663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb17244b-a344-4301-85de-1a95d29a8fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:11:56Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4df723b-ffeb-4c58-8d6f-a91b5feebbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4df723b-ffeb-4c58-8d6f-a91b5feebbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b02963-cf48-4472-8d82-8876de2fc928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b02963-cf48-4472-8d82-8876de2fc928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb17244b-a344-4301-85de-1a95d29a8fc6', 'volume_name': 'volume-fb17244b-a344-4301-85de-1a95d29a8fc6', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed1dd38-a78c-4da6-9aa0-a053437cff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed1dd38-a78c-4da6-9aa0-a053437cff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230f212f-4af8-4cc2-b423-76341b341878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:56 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Volume fb17244b-a344-4301-85de-1a95d29a8fc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb17244b-a344-4301-85de-1a95d29a8fc6', 'volume_size': 1} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:11:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-860498145',display_name='tempest-VolumesGetTest-Volume-1635479663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb17244b-a344-4301-85de-1a95d29a8fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:11:56Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Creating volume fb17244b-a344-4301-85de-1a95d29a8fc6 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:11:56 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:56 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6 1073741824 Jul 16 11:11:56 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:56 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6 1073741824" returned: 0 in 0.406s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:56 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6 Jul 16 11:11:56 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:57 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-454974a6-b8c4-48e4-a815-cd953e71b2c7 tempest-VolumesActionsTest-1700251723 None] Acquiring lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217" by "attach_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (230f212f-4af8-4cc2-b423-76341b341878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb17244b-a344-4301-85de-1a95d29a8fc6', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dce943d-a386-4636-a847-049ec60392a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:11:57 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Volume volume-fb17244b-a344-4301-85de-1a95d29a8fc6 (fb17244b-a344-4301-85de-1a95d29a8fc6): created successfully Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dce943d-a386-4636-a847-049ec60392a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (8730bf6b-aafe-4b81-8f78-78ad59b1fc5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-454974a6-b8c4-48e4-a815-cd953e71b2c7 tempest-VolumesActionsTest-1700251723 None] Lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217" acquired by "attach_volume" :: waited 0.051s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:57 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c708591d-9d41-4911-9f4b-d515df375b02 tempest-VolumesGetTest-97582787 None] Created volume successfully. Jul 16 11:11:57 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-454974a6-b8c4-48e4-a815-cd953e71b2c7 tempest-VolumesActionsTest-1700251723 None] Attaching volume 596c221f-c944-48aa-a2c6-90a74fab4217 to instance 615e0fc7-7184-44c7-9564-a4b2cb3fa709 at mountpoint /dev/vdb on host None. Jul 16 11:11:57 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-454974a6-b8c4-48e4-a815-cd953e71b2c7 tempest-VolumesActionsTest-1700251723 None] Attach volume completed successfully. Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-454974a6-b8c4-48e4-a815-cd953e71b2c7 tempest-VolumesActionsTest-1700251723 None] Lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217" released by "attach_volume" :: held 0.112s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-fb17244b-a344-4301-85de-1a95d29a8fc6-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Lock "cinder-fb17244b-a344-4301-85de-1a95d29a8fc6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-quobyte-fb17244b-a344-4301-85de-1a95d29a8fc6" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-fb17244b-a344-4301-85de-1a95d29a8fc6" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27f2255-5f7a-4b27-a8dd-26f53bd38c4c]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:57 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6 Jul 16 11:11:57 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:57 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7c47948c-d48b-4cf8-8032-51824db2504b tempest-VolumesActionsTest-41618928 None] Terminate volume connection completed successfully. Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7c47948c-d48b-4cf8-8032-51824db2504b tempest-VolumesActionsTest-41618928 None] Acquiring lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217-detach_volume" by "detach_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7c47948c-d48b-4cf8-8032-51824db2504b tempest-VolumesActionsTest-41618928 None] Lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:57 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7c47948c-d48b-4cf8-8032-51824db2504b tempest-VolumesActionsTest-41618928 None] Detaching volume 596c221f-c944-48aa-a2c6-90a74fab4217 from instance 615e0fc7-7184-44c7-9564-a4b2cb3fa709. Jul 16 11:11:57 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7c47948c-d48b-4cf8-8032-51824db2504b tempest-VolumesActionsTest-41618928 None] Detach volume completed successfully. Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7c47948c-d48b-4cf8-8032-51824db2504b tempest-VolumesActionsTest-41618928 None] Lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:58 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6" returned: 0 in 0.423s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:58 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6 Jul 16 11:11:58 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5ae64ba7-9dc5-47e5-8eaf-80ec3d182db0 tempest-VolumesActionsTest-1700251723 None] Acquiring lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217-detach_volume" by "detach_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5ae64ba7-9dc5-47e5-8eaf-80ec3d182db0 tempest-VolumesActionsTest-1700251723 None] Lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:58 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5ae64ba7-9dc5-47e5-8eaf-80ec3d182db0 tempest-VolumesActionsTest-1700251723 None] Volume detach called, but volume not attached. Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5ae64ba7-9dc5-47e5-8eaf-80ec3d182db0 tempest-VolumesActionsTest-1700251723 None] Lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:58 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fb17244b-a344-4301-85de-1a95d29a8fc6" returned: 0 in 0.294s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-fb17244b-a344-4301-85de-1a95d29a8fc6" released by "delete_volume" :: held 0.775s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Acquiring lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Created reservations ['508b1c36-89d9-4d35-b078-8c8330751cdd', '1d69eb80-bb0e-401f-bdb5-ee8f4e938ed1', '7232d51a-25a3-4a4d-ab6d-e36651a53b5c', '9d1a243e-9efd-49e2-969e-3b1855e07e2f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Acquiring lock "cinder-quobyte-596c221f-c944-48aa-a2c6-90a74fab4217" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Lock "cinder-quobyte-596c221f-c944-48aa-a2c6-90a74fab4217" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[046a3182-fea9-4972-8db9-51f237502eec]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:58 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:11:58 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:58 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217 Jul 16 11:11:58 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:58 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.261s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:11:58 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Deleted volume successfully. Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-bd64b688-30f1-48d0-abb6-1a1afc9de3f9-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Lock "cinder-bd64b688-30f1-48d0-abb6-1a1afc9de3f9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bdb664c6-db81-49aa-bfa2-975a6c1188df tempest-VolumesGetTest-97582787 None] Lock "cinder-fb17244b-a344-4301-85de-1a95d29a8fc6-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-quobyte-bd64b688-30f1-48d0-abb6-1a1afc9de3f9" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:11:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-bd64b688-30f1-48d0-abb6-1a1afc9de3f9" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[849c0153-4b5d-436a-bd58-0f443918fe6d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:59 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217" returned: 0 in 0.494s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:59 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217 Jul 16 11:11:59 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:59 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 Jul 16 11:11:59 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:59 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-596c221f-c944-48aa-a2c6-90a74fab4217" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Lock "cinder-quobyte-596c221f-c944-48aa-a2c6-90a74fab4217" released by "delete_volume" :: held 0.800s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:59 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9" returned: 0 in 0.388s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:59 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9 Jul 16 11:11:59 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Created reservations ['fc5d7277-042c-4268-ad4f-0375fabb3867', 'cca4bea6-8054-4076-8597-1c66d20ddd06', '5b8fb3b2-0349-47d4-a93e-2bc2f6d030b6', '743b1e18-8ef6-4856-a6c7-06918ebec1d7'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:59 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:11:59 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:11:59 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bd64b688-30f1-48d0-abb6-1a1afc9de3f9" returned: 0 in 0.313s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-bd64b688-30f1-48d0-abb6-1a1afc9de3f9" released by "delete_volume" :: held 0.753s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Created reservations ['a4ec5529-4707-468c-a932-7a50bd80811a', '97ed9dda-c851-4577-9149-0d85fea87da5', '0ce67881-023f-440f-b169-b1b24d7ae1cd', 'b4fee846-abb3-4018-949f-bc1e1c773ff9'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:11:59 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.297s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:11:59 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Deleted volume successfully. Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d297aafa-b52f-4424-a0f7-5ba8f8e5b8ed tempest-VolumesActionsTest-1700251723 None] Lock "cinder-596c221f-c944-48aa-a2c6-90a74fab4217-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:11:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:11:59 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:11:59 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Lock "cinder-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-quobyte-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d" acquired by "delete_volume" :: waited 0.053s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:00 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.406s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:00 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:00 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Deleted volume successfully. Jul 16 11:12:00 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46c2526-9bd4-4097-8f2c-95342ee7f36f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-52335ce8-1169-4b47-9361-f9c09f8b0963 tempest-VolumesGetTest-97582787 None] Lock "cinder-bd64b688-30f1-48d0-abb6-1a1afc9de3f9-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:00 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d Jul 16 11:12:00 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:00 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d" returned: 0 in 0.407s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:00 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d Jul 16 11:12:00 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:01 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d" returned: 0 in 0.260s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d" released by "delete_volume" :: held 0.790s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Created reservations ['85475e9b-6480-4910-a5a1-bc4310060349', '79754894-5eca-4479-9466-44f2270a7313', '465e1cd5-5792-4265-b1ef-1227dedd19f5', 'a14d3adb-4bb6-4eb2-9dd2-33f9c6fbce30'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:01 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:01 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:01 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.369s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:01 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Deleted volume successfully. Jul 16 11:12:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-97678ff3-5b31-4979-9cd5-19cf8d1147fa tempest-VolumesGetTest-97582787 None] Lock "cinder-6c07e7ff-d440-42bf-bfce-c0d35bcc2b3d-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (1f82a375-1402-4ba7-babd-c96da3665fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0d9bea-6b9d-4222-9c8e-68fabfdaae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0d9bea-6b9d-4222-9c8e-68fabfdaae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-647449905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fba548e-8c58-470e-91c9-d2430194ffd9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:02Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e83b3a6-38e9-4cfc-9335-01a695703c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e83b3a6-38e9-4cfc-9335-01a695703c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35594e5-129c-4ba0-b289-111ac4a4ab96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.image.glance [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Creating Keystone auth plugin from conf {{(pid=87345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35594e5-129c-4ba0-b289-111ac4a4ab96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5fba548e-8c58-470e-91c9-d2430194ffd9', 'volume_name': 'volume-5fba548e-8c58-470e-91c9-d2430194ffd9', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f60f939-e000-4511-b4d5-2797d0c94db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f60f939-e000-4511-b4d5-2797d0c94db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3853e60-254b-41cc-8e87-34ab0099f57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:02 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Volume 5fba548e-8c58-470e-91c9-d2430194ffd9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5fba548e-8c58-470e-91c9-d2430194ffd9', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Trying to clone 5fba548e-8c58-470e-91c9-d2430194ffd9 from image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f at location (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]). {{(pid=87345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 11:12:02 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Image download 20.69 MB at 20.69 MB/s Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf0f448-eebd-4d08-a0cc-9324494a4a87]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:03 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD Jul 16 11:12:03 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (71af85b5-85a1-4e90-bfd5-13a8e38adb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e91bf6c-0113-4f80-bf0a-65391f3ce6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e91bf6c-0113-4f80-bf0a-65391f3ce6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1416295173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c007bc6b-40dd-4956-a310-08ef5b7fecef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:03Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94236d0f-bec5-4d50-aabd-bbae6d0af293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94236d0f-bec5-4d50-aabd-bbae6d0af293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc60fd88-91c2-4c32-9f1f-58e5e3d89074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc60fd88-91c2-4c32-9f1f-58e5e3d89074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c007bc6b-40dd-4956-a310-08ef5b7fecef', 'volume_name': 'volume-c007bc6b-40dd-4956-a310-08ef5b7fecef', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81895c57-561a-40a3-b8a1-e1259409b743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81895c57-561a-40a3-b8a1-e1259409b743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898cd250-b711-44a7-bb98-63eab0d49bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:03 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Volume c007bc6b-40dd-4956-a310-08ef5b7fecef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c007bc6b-40dd-4956-a310-08ef5b7fecef', 'volume_size': 1} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1416295173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c007bc6b-40dd-4956-a310-08ef5b7fecef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:03Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Creating volume c007bc6b-40dd-4956-a310-08ef5b7fecef {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:03 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:03 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef 1073741824 Jul 16 11:12:03 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:03 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Temporary image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f is fetched for user f158a98dae8d4011a06972a6ed05b43e. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa69d7e-d706-4687-88ce-c2e1f24f0625]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:03 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD Jul 16 11:12:03 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:03 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef 1073741824" returned: 0 in 0.426s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:03 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef Jul 16 11:12:03 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:03 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:03 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef" returned: 0 in 0.244s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.196s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-647449905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fba548e-8c58-470e-91c9-d2430194ffd9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:02Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Creating volume 5fba548e-8c58-470e-91c9-d2430194ffd9 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:03 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898cd250-b711-44a7-bb98-63eab0d49bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c007bc6b-40dd-4956-a310-08ef5b7fecef', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f76387f-ee79-42e5-9550-8b81fbb1326c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:03 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 1073741824 Jul 16 11:12:03 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:03 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Volume volume-c007bc6b-40dd-4956-a310-08ef5b7fecef (c007bc6b-40dd-4956-a310-08ef5b7fecef): created successfully Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f76387f-ee79-42e5-9550-8b81fbb1326c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (71af85b5-85a1-4e90-bfd5-13a8e38adb05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:03 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-655f06f8-cdf4-4b34-9c9e-0b5de7588aea tempest-VolumesActionsTest-1700251723 None] Created volume successfully. Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Acquiring lock "cinder-c007bc6b-40dd-4956-a310-08ef5b7fecef-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Lock "cinder-c007bc6b-40dd-4956-a310-08ef5b7fecef-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Acquiring lock "cinder-quobyte-c007bc6b-40dd-4956-a310-08ef5b7fecef" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Lock "cinder-quobyte-c007bc6b-40dd-4956-a310-08ef5b7fecef" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c728ef-2e55-4ed8-a964-86186ea0999b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:04 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 1073741824" returned: 0 in 0.482s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:04 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 Jul 16 11:12:04 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:04 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef Jul 16 11:12:04 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:04 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9" returned: 0 in 0.258s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Attempting download of 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f ((None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}])) to volume 5fba548e-8c58-470e-91c9-d2430194ffd9. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 11:12:04 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef" returned: 0 in 0.363s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:04 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef Jul 16 11:12:04 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd42d777-0732-46d2-911a-232c6f2e61cb]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_h7fz9kz6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:04 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_h7fz9kz6 Jul 16 11:12:04 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:04 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c007bc6b-40dd-4956-a310-08ef5b7fecef" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Lock "cinder-quobyte-c007bc6b-40dd-4956-a310-08ef5b7fecef" released by "delete_volume" :: held 0.657s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Created reservations ['6315d21f-f965-4b51-97c5-40664f0797c4', '548d0b02-dea4-4eab-a855-310baccff0ac', '042144e7-df6e-4bfe-940e-2b31f8404222', '656f2e7a-7051-43d6-93ca-6a80e5fc3845'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:05 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_h7fz9kz6" returned: 0 in 0.332s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_h7fz9kz6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:05 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:05 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:05 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_h7fz9kz6 Jul 16 11:12:05 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:05 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.264s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:05 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Deleted volume successfully. Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-114aacc1-14b3-483d-b531-6310f93732c1 tempest-VolumesActionsTest-41618928 None] Lock "cinder-c007bc6b-40dd-4956-a310-08ef5b7fecef-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:05 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_h7fz9kz6" returned: 1 in 0.345s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_h7fz9kz6' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfd74eb-2fd7-4e4d-ba4b-743895af82b2]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:05 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD Jul 16 11:12:05 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:05 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f was qcow2, converting to qcow2 {{(pid=87345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:05 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 Jul 16 11:12:05 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (ff135219-5154-43fa-a287-7de0b405763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc43680-de84-45ab-820c-0a1d508e02e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc43680-de84-45ab-820c-0a1d508e02e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-234163071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb6af93-37a6-4a74-870e-be5dae342a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:06Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ed3d79-05ea-4612-82b0-049f9c13dbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ed3d79-05ea-4612-82b0-049f9c13dbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51e6901-efa1-4bda-bfc2-fbfac8422954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51e6901-efa1-4bda-bfc2-fbfac8422954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb6af93-37a6-4a74-870e-be5dae342a72', 'volume_name': 'volume-8cb6af93-37a6-4a74-870e-be5dae342a72', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8694d4a-73cb-4e15-9552-8f206dfd0afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8694d4a-73cb-4e15-9552-8f206dfd0afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79793a70-1452-4923-a17d-c6d9042c6db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:06 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Volume 8cb6af93-37a6-4a74-870e-be5dae342a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb6af93-37a6-4a74-870e-be5dae342a72', 'volume_size': 1} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-234163071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb6af93-37a6-4a74-870e-be5dae342a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:06Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Creating volume 8cb6af93-37a6-4a74-870e-be5dae342a72 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:06 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:06 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72 1073741824 Jul 16 11:12:06 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:06 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72 1073741824" returned: 0 in 0.518s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:06 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72 Jul 16 11:12:06 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:06 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72" returned: 0 in 0.254s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79793a70-1452-4923-a17d-c6d9042c6db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb6af93-37a6-4a74-870e-be5dae342a72', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324b86a8-76b2-4258-bd5c-b44146f8193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:06 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Volume volume-8cb6af93-37a6-4a74-870e-be5dae342a72 (8cb6af93-37a6-4a74-870e-be5dae342a72): created successfully Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324b86a8-76b2-4258-bd5c-b44146f8193c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (ff135219-5154-43fa-a287-7de0b405763b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:06 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d9b2978a-b283-4737-9298-a0e5ab7460dd tempest-VolumesActionsTest-1700251723 None] Created volume successfully. Jul 16 11:12:07 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9" returned: 0 in 1.613s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_80aom63ndevstack@QuobyteHD, size 112.00 MB, duration 1.61 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:12:07 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Converted 112.00 MB image at 69.40 MB/s Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:07 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 1G Jul 16 11:12:07 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:07 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 1G" returned: 0 in 0.307s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Downloaded image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f ((None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}])) to volume 5fba548e-8c58-470e-91c9-d2430194ffd9 successfully. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Temporary image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f for user f158a98dae8d4011a06972a6ed05b43e is deleted. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Marking volume 5fba548e-8c58-470e-91c9-d2430194ffd9 as bootable. {{(pid=87345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Copying metadata from image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f to 5fba548e-8c58-470e-91c9-d2430194ffd9. {{(pid=87345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Creating volume glance metadata for volume 5fba548e-8c58-470e-91c9-d2430194ffd9 backed by image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3853e60-254b-41cc-8e87-34ab0099f57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fba548e-8c58-470e-91c9-d2430194ffd9', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdf5a7d-8c13-46a5-8aaa-dfdc3f539aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Volume volume-5fba548e-8c58-470e-91c9-d2430194ffd9 (5fba548e-8c58-470e-91c9-d2430194ffd9): created successfully Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdf5a7d-8c13-46a5-8aaa-dfdc3f539aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (1f82a375-1402-4ba7-babd-c96da3665fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:07 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-bb1d2002-ca5e-4f78-849c-11fef9ee38cd tempest-VolumesGetTest-97582787 None] Created volume successfully. Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Acquiring lock "cinder-8cb6af93-37a6-4a74-870e-be5dae342a72-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Lock "cinder-8cb6af93-37a6-4a74-870e-be5dae342a72-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Acquiring lock "cinder-quobyte-8cb6af93-37a6-4a74-870e-be5dae342a72" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Lock "cinder-quobyte-8cb6af93-37a6-4a74-870e-be5dae342a72" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd6915e-892a-4c31-965d-c84b10e97920]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:08 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72 Jul 16 11:12:08 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:08 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72" returned: 0 in 0.354s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:08 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72 Jul 16 11:12:08 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:08 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8cb6af93-37a6-4a74-870e-be5dae342a72" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Lock "cinder-quobyte-8cb6af93-37a6-4a74-870e-be5dae342a72" released by "delete_volume" :: held 0.647s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Created reservations ['db59e95e-510b-41ea-8f75-109b5f6f8a0f', '72750825-5175-4137-a270-aa0516d66a8e', '717f4636-0893-43cb-87ad-2564b4a3e9af', '6231f1f6-ecf5-49a9-803b-af117af1a710'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:08 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:08 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:09 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Deleted volume successfully. Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-482a05b4-fe4e-421c-9c71-331d7e6207d2 tempest-VolumesActionsTest-41618928 None] Lock "cinder-8cb6af93-37a6-4a74-870e-be5dae342a72-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (fbefe960-cc90-464a-9800-115ef2e90f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7003061-d29e-4cdb-9543-d9ddcb36bf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7003061-d29e-4cdb-9543-d9ddcb36bf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1400476704',display_name='tempest-VolumesGetTest-Volume-271683139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba410b1-52f6-4e1a-a79a-5131414be151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:09Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48229287-b318-40e2-b2b0-6a546d9b7d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48229287-b318-40e2-b2b0-6a546d9b7d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019659ff-efd4-418f-a2e8-68f361ac98be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019659ff-efd4-418f-a2e8-68f361ac98be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ba410b1-52f6-4e1a-a79a-5131414be151', 'volume_name': 'volume-0ba410b1-52f6-4e1a-a79a-5131414be151', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bb4234-fe2e-4c3f-ade7-83f47b466a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69bb4234-fe2e-4c3f-ade7-83f47b466a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6738ebe0-e908-4c9c-8a87-53c30182634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Volume 0ba410b1-52f6-4e1a-a79a-5131414be151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ba410b1-52f6-4e1a-a79a-5131414be151', 'volume_size': 1} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1400476704',display_name='tempest-VolumesGetTest-Volume-271683139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba410b1-52f6-4e1a-a79a-5131414be151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb3acf52f340ae8978165abd0084ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:09Z,use_quota=True,user_id='f158a98dae8d4011a06972a6ed05b43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Creating volume 0ba410b1-52f6-4e1a-a79a-5131414be151 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:09 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:09 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151 1073741824 Jul 16 11:12:09 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (117f52b2-5545-4505-8f50-e54ffc095591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf2812d-b5d0-4e42-83cc-f59e722f1fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf2812d-b5d0-4e42-83cc-f59e722f1fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1469652835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b35a31-d0a1-46e1-afb0-36134e56796b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:10Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fb280f-d871-4210-a0fd-c45a9a3ea13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fb280f-d871-4210-a0fd-c45a9a3ea13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f05e90-db89-4f8e-ad73-76a88bb53e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f05e90-db89-4f8e-ad73-76a88bb53e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b35a31-d0a1-46e1-afb0-36134e56796b', 'volume_name': 'volume-89b35a31-d0a1-46e1-afb0-36134e56796b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd68a6c-9b22-4474-83d9-8212648e0158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd68a6c-9b22-4474-83d9-8212648e0158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:09 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed49a64-2ea4-461c-bcf5-7354d34345f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Volume 89b35a31-d0a1-46e1-afb0-36134e56796b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b35a31-d0a1-46e1-afb0-36134e56796b', 'volume_size': 1} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151 1073741824" returned: 0 in 0.433s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:09 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151 Jul 16 11:12:09 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:10 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151" returned: 0 in 0.244s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.278s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1469652835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b35a31-d0a1-46e1-afb0-36134e56796b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:10Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Creating volume 89b35a31-d0a1-46e1-afb0-36134e56796b {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:10 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6738ebe0-e908-4c9c-8a87-53c30182634c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ba410b1-52f6-4e1a-a79a-5131414be151', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ce5646-c989-4335-9545-80aba01e9801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:10 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b 1073741824 Jul 16 11:12:10 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:10 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Volume volume-0ba410b1-52f6-4e1a-a79a-5131414be151 (0ba410b1-52f6-4e1a-a79a-5131414be151): created successfully Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ce5646-c989-4335-9545-80aba01e9801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Flow 'volume_create_manager' (fbefe960-cc90-464a-9800-115ef2e90f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:10 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7061286d-af3e-4d23-9160-0535b62523d2 tempest-VolumesGetTest-97582787 None] Created volume successfully. Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-0ba410b1-52f6-4e1a-a79a-5131414be151-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Lock "cinder-0ba410b1-52f6-4e1a-a79a-5131414be151-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-quobyte-0ba410b1-52f6-4e1a-a79a-5131414be151" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-0ba410b1-52f6-4e1a-a79a-5131414be151" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc81c079-a5ac-41de-a639-ebb42188a121]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:10 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b 1073741824" returned: 0 in 0.466s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:10 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b Jul 16 11:12:10 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:10 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151 Jul 16 11:12:10 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:10 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b" returned: 0 in 0.247s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed49a64-2ea4-461c-bcf5-7354d34345f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b35a31-d0a1-46e1-afb0-36134e56796b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f4decea-e664-412e-83cc-b8eb25e0b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:10 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Volume volume-89b35a31-d0a1-46e1-afb0-36134e56796b (89b35a31-d0a1-46e1-afb0-36134e56796b): created successfully Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f4decea-e664-412e-83cc-b8eb25e0b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:10 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (117f52b2-5545-4505-8f50-e54ffc095591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151" returned: 0 in 0.375s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:10 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c229dc5f-2cc2-4562-b0d8-70c642cb037f tempest-VolumesActionsTest-1700251723 None] Created volume successfully. Jul 16 11:12:10 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151 Jul 16 11:12:10 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:11 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0ba410b1-52f6-4e1a-a79a-5131414be151" returned: 0 in 0.237s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-0ba410b1-52f6-4e1a-a79a-5131414be151" released by "delete_volume" :: held 0.650s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Created reservations ['8c7bc628-d24f-41e7-a402-18ccd65de0a4', 'cc32edb9-3761-404a-b37c-07c8ffbaa53f', '5042c2c1-4959-4294-9a49-e4c28f6fcf5e', '6f800511-db4d-46dd-9e89-1b5d3c771e31'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:11 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:11 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:11 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.234s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:11 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Deleted volume successfully. Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8699a959-b198-4fad-b285-ad7a26e088bc tempest-VolumesGetTest-97582787 None] Lock "cinder-0ba410b1-52f6-4e1a-a79a-5131414be151-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-5fba548e-8c58-470e-91c9-d2430194ffd9-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Lock "cinder-5fba548e-8c58-470e-91c9-d2430194ffd9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Acquiring lock "cinder-quobyte-5fba548e-8c58-470e-91c9-d2430194ffd9" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-5fba548e-8c58-470e-91c9-d2430194ffd9" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[45149b94-1c81-41b3-821d-1ff1358a9b4d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:11 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 Jul 16 11:12:11 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:11 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Acquiring lock "cinder-89b35a31-d0a1-46e1-afb0-36134e56796b-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Lock "cinder-89b35a31-d0a1-46e1-afb0-36134e56796b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Acquiring lock "cinder-quobyte-89b35a31-d0a1-46e1-afb0-36134e56796b" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Lock "cinder-quobyte-89b35a31-d0a1-46e1-afb0-36134e56796b" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffae77b2-31ba-4913-b43c-c91f1fe4b535]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:12 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9" returned: 0 in 0.358s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:12 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9 Jul 16 11:12:12 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:12 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b Jul 16 11:12:12 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:12 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5fba548e-8c58-470e-91c9-d2430194ffd9" returned: 0 in 0.251s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Lock "cinder-quobyte-5fba548e-8c58-470e-91c9-d2430194ffd9" released by "delete_volume" :: held 0.651s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Created reservations ['3faf7555-4e4a-4de6-9629-4399c8ae047a', '8379f9e7-84f0-43bb-b8bc-bdecfa57c76d', '6c4ad529-4f5f-4d5d-8ccc-c17f2040f79a', '8a812f6e-2f37-4fe4-821f-bf3ad4c173f3'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:12 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b" returned: 0 in 0.362s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:12 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b Jul 16 11:12:12 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:12 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:12 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:12 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-89b35a31-d0a1-46e1-afb0-36134e56796b" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Lock "cinder-quobyte-89b35a31-d0a1-46e1-afb0-36134e56796b" released by "delete_volume" :: held 0.652s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Created reservations ['9f793b99-54a2-4247-8dea-071be6ec1372', 'adf8ed83-8fdd-4cdf-979b-5363469091dc', '38cce89d-48d8-46f6-8c51-62a164f418ba', '9a0722f5-b040-4274-bc6b-d1a92cddf1f0'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:12 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.253s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:12 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Deleted volume successfully. Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-afc4ae5c-f6db-46e1-aec5-561f43f40847 tempest-VolumesGetTest-97582787 None] Lock "cinder-5fba548e-8c58-470e-91c9-d2430194ffd9-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:12 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:12 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:13 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.262s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:13 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Deleted volume successfully. Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2206b71e-e4db-483a-b347-aefacc928d0c tempest-VolumesActionsTest-41618928 None] Lock "cinder-89b35a31-d0a1-46e1-afb0-36134e56796b-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (916739fb-121b-40f8-8b77-73c262a2c628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72ecd52-30de-4e70-9e12-95b1bda55bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72ecd52-30de-4e70-9e12-95b1bda55bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2137650498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8b5c54-c54b-4b88-8baf-d040d41baafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:14Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b511646b-c367-44cc-88ba-c2d6b5212960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b511646b-c367-44cc-88ba-c2d6b5212960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a4bfeb-74d5-46d0-8e66-f68a32a58125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a4bfeb-74d5-46d0-8e66-f68a32a58125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8b5c54-c54b-4b88-8baf-d040d41baafc', 'volume_name': 'volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cdbabf-0586-4d55-9f3a-ab0636abd7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cdbabf-0586-4d55-9f3a-ab0636abd7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107f5f19-ee2a-4a47-ba52-1852f7ab4674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:13 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Volume 2b8b5c54-c54b-4b88-8baf-d040d41baafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc', 'volume_size': 1} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2137650498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8b5c54-c54b-4b88-8baf-d040d41baafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:14Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Creating volume 2b8b5c54-c54b-4b88-8baf-d040d41baafc {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:13 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:13 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc 1073741824 Jul 16 11:12:13 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:14 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc 1073741824" returned: 0 in 0.480s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:14 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc Jul 16 11:12:14 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:14 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc" returned: 0 in 0.245s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107f5f19-ee2a-4a47-ba52-1852f7ab4674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3952e0f-66d3-421c-8c88-b17df9ec8a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:14 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Volume volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc (2b8b5c54-c54b-4b88-8baf-d040d41baafc): created successfully Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3952e0f-66d3-421c-8c88-b17df9ec8a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (916739fb-121b-40f8-8b77-73c262a2c628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:14 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-fe4babb0-2601-498e-9200-fe0f53ece201 tempest-VolumesActionsTest-1700251723 None] Created volume successfully. Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Acquiring lock "cinder-2b8b5c54-c54b-4b88-8baf-d040d41baafc-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Lock "cinder-2b8b5c54-c54b-4b88-8baf-d040d41baafc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Acquiring lock "cinder-quobyte-2b8b5c54-c54b-4b88-8baf-d040d41baafc" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Lock "cinder-quobyte-2b8b5c54-c54b-4b88-8baf-d040d41baafc" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3173bf0-247d-4f33-ac04-d27ce5b8b09a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:15 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc Jul 16 11:12:15 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:15 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc" returned: 0 in 0.366s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:15 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc Jul 16 11:12:15 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:15 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2b8b5c54-c54b-4b88-8baf-d040d41baafc" returned: 0 in 0.258s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Lock "cinder-quobyte-2b8b5c54-c54b-4b88-8baf-d040d41baafc" released by "delete_volume" :: held 0.665s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:15 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Created reservations ['74c28e74-eb5e-411b-b74d-fb46ea79e994', '37476ceb-e886-404b-91dd-36d75559f575', '506929e0-163e-4434-8b96-4aec03ac4995', '6da33a03-6bb4-4142-a279-7f0d87630e5a'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:15 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:15 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:16 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.273s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:16 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Deleted volume successfully. Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6a128408-b3e0-4705-b4c8-625de8a71cbc tempest-VolumesActionsTest-41618928 None] Lock "cinder-2b8b5c54-c54b-4b88-8baf-d040d41baafc-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (74c7c267-c28b-476b-8912-ff456beba7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39abe99e-ebae-4a84-b455-87fc8ccb3661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39abe99e-ebae-4a84-b455-87fc8ccb3661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-242404063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04349efb-7483-43a5-b368-c8b627110361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:17Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afc646a-a5c4-4006-8487-e5006bb61b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afc646a-a5c4-4006-8487-e5006bb61b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ab123f-be15-46fb-8a15-9556bf8548a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ab123f-be15-46fb-8a15-9556bf8548a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04349efb-7483-43a5-b368-c8b627110361', 'volume_name': 'volume-04349efb-7483-43a5-b368-c8b627110361', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161dd446-dbe4-4521-b8b9-2799341ac86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161dd446-dbe4-4521-b8b9-2799341ac86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52344dc-462f-469a-9036-d2124652b9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:16 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Volume 04349efb-7483-43a5-b368-c8b627110361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04349efb-7483-43a5-b368-c8b627110361', 'volume_size': 1} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-242404063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04349efb-7483-43a5-b368-c8b627110361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c00c2b5f054570b0bd0c1171b0c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:17Z,use_quota=True,user_id='865259291d884e2bb1e6c809772fe798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Creating volume 04349efb-7483-43a5-b368-c8b627110361 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:16 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:16 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361 1073741824 Jul 16 11:12:16 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:17 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361 1073741824" returned: 0 in 0.457s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:17 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361 Jul 16 11:12:17 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:17 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361" returned: 0 in 0.263s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:17 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=109,cinder:UPDATE=157,cinder:INSERT=39,cinder:DELETE=11 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:12:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52344dc-462f-469a-9036-d2124652b9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04349efb-7483-43a5-b368-c8b627110361', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ccb641-4fbf-43d2-af7e-1058cdead203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:17 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Volume volume-04349efb-7483-43a5-b368-c8b627110361 (04349efb-7483-43a5-b368-c8b627110361): created successfully Jul 16 11:12:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ccb641-4fbf-43d2-af7e-1058cdead203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Flow 'volume_create_manager' (74c7c267-c28b-476b-8912-ff456beba7fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-850fb47d-3c91-4b4d-9430-427dcc127e94 tempest-VolumesActionsTest-1700251723 None] Created volume successfully. Jul 16 11:12:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Acquiring lock "cinder-04349efb-7483-43a5-b368-c8b627110361-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Lock "cinder-04349efb-7483-43a5-b368-c8b627110361-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Acquiring lock "cinder-quobyte-04349efb-7483-43a5-b368-c8b627110361" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Lock "cinder-quobyte-04349efb-7483-43a5-b368-c8b627110361" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:18 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[491600d3-8da5-434c-82f4-66be324c3763]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:18 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361 Jul 16 11:12:18 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:18 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361" returned: 0 in 0.372s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:18 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361 Jul 16 11:12:18 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:18 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-04349efb-7483-43a5-b368-c8b627110361" returned: 0 in 0.244s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Lock "cinder-quobyte-04349efb-7483-43a5-b368-c8b627110361" released by "delete_volume" :: held 0.662s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:19 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Created reservations ['0a6233ab-6c02-4213-904d-2d4d9c73a354', 'edea5757-270a-40a5-bd04-168d8d06c4b6', '9bc717c9-565b-4ece-a658-27704eb704af', '83e511d1-42f6-402c-b2e8-33ae192eee52'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:19 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:19 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:19 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.378s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:19 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:19 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Deleted volume successfully. Jul 16 11:12:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c6ff8175-4ad0-4f47-b304-31b052837ff5 tempest-VolumesActionsTest-1700251723 None] Lock "cinder-04349efb-7483-43a5-b368-c8b627110361-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Flow 'volume_create_manager' (d62b739e-0e84-4a9e-a01d-c872f211e0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5e16d5-35b7-45df-8ddc-b92433761d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5e16d5-35b7-45df-8ddc-b92433761d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-420045366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17aec0d6-5268-4b73-9abf-cb22d2d6eee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5f0a4f9493464cb0606c18b83c8453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:24Z,use_quota=True,user_id='a0f9383d137c48728be9fb46ca85b476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a4addd-1654-4f9c-97fe-6a95c6ddac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a4addd-1654-4f9c-97fe-6a95c6ddac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ddcf91-a889-40fc-b95c-b671f757ed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ddcf91-a889-40fc-b95c-b671f757ed59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17aec0d6-5268-4b73-9abf-cb22d2d6eee1', 'volume_name': 'volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fe4873-eda2-45f3-98ca-a38a734afc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8fe4873-eda2-45f3-98ca-a38a734afc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8468f88d-8bbc-4f4a-92e9-0a7329d2a3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:24 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume 17aec0d6-5268-4b73-9abf-cb22d2d6eee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1', 'volume_size': 1} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-420045366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17aec0d6-5268-4b73-9abf-cb22d2d6eee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5f0a4f9493464cb0606c18b83c8453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:24Z,use_quota=True,user_id='a0f9383d137c48728be9fb46ca85b476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Creating volume 17aec0d6-5268-4b73-9abf-cb22d2d6eee1 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:24 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:24 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 1073741824 Jul 16 11:12:24 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:24 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 1073741824" returned: 0 in 0.482s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:24 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 Jul 16 11:12:24 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:25 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1" returned: 0 in 0.275s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8468f88d-8bbc-4f4a-92e9-0a7329d2a3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fd644d-54fd-4ac9-a0b5-06b25153b973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:25 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 (17aec0d6-5268-4b73-9abf-cb22d2d6eee1): created successfully Jul 16 11:12:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fd644d-54fd-4ac9-a0b5-06b25153b973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Flow 'volume_create_manager' (d62b739e-0e84-4a9e-a01d-c872f211e0ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:25 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ba832771-ff28-4d0d-97bf-bcc6ad2ebc37 tempest-VolumesSnapshotTestJSON-1999371902 None] Created volume successfully. Jul 16 11:12:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] Creating offline snapshot 8aa9acf5-4348-4da6-aa95-8ada8d69f43a of volume 17aec0d6-5268-4b73-9abf-cb22d2d6eee1 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:12:26 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ae97cd-1f8e-4833-819d-b74fb83a0280]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:26 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 Jul 16 11:12:26 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:27 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1" returned: 0 in 0.365s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:27 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a 1G Jul 16 11:12:27 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:27 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a 1G" returned: 0 in 0.434s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:27 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a Jul 16 11:12:27 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:27 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a" returned: 0 in 0.287s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:27 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a is being set with open permissions: ugo+rw Jul 16 11:12:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:27 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a Jul 16 11:12:27 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:27 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a" returned: 0 in 0.244s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:28 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=122,cinder:INSERT=45,cinder:UPDATE=158,cinder:DELETE=15 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:12:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:28 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.info Jul 16 11:12:28 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:28 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.info" returned: 0 in 0.264s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:28 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.info is being set with open permissions: ugo+rw Jul 16 11:12:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:28 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.info Jul 16 11:12:28 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:28 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.info" returned: 0 in 0.274s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-84790fa1-1279-4f20-86d9-80f2c7281c00 tempest-VolumesSnapshotTestJSON-1999371902 None] Create snapshot completed successfully Jul 16 11:12:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-8aa9acf5-4348-4da6-aa95-8ada8d69f43a-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-8aa9acf5-4348-4da6-aa95-8ada8d69f43a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-17aec0d6-5268-4b73-9abf-cb22d2d6eee1" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-17aec0d6-5268-4b73-9abf-cb22d2d6eee1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-8aa9acf5-4348-4da6-aa95-8ada8d69f43a" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-8aa9acf5-4348-4da6-aa95-8ada8d69f43a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Deleting offline snapshot 8aa9acf5-4348-4da6-aa95-8ada8d69f43a of volume 17aec0d6-5268-4b73-9abf-cb22d2d6eee1 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:12:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] snapshot_file for this snap is: volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:12:30 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f694854f-9714-4eae-b915-636ae7c8eb8a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:30 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a Jul 16 11:12:30 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:30 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a" returned: 0 in 0.367s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:12:30 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c9e748-6009-403f-959c-b3b7e312f1b8]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:30 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 Jul 16 11:12:30 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:30 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1" returned: 0 in 0.363s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:30 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a Jul 16 11:12:30 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:31 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a" returned: 0 in 0.325s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:31 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a Jul 16 11:12:31 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:31 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1.8aa9acf5-4348-4da6-aa95-8ada8d69f43a" returned: 0 in 0.239s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-8aa9acf5-4348-4da6-aa95-8ada8d69f43a" released by "_delete_snapshot" :: held 1.407s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-17aec0d6-5268-4b73-9abf-cb22d2d6eee1" released by "delete_snapshot" :: held 1.428s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:31 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Created reservations ['b8734194-fcfd-4165-8a76-e4fc4cc61d46', 'ec9c6d2d-fd5b-4c64-a50e-c7d486a6d84e', 'c5bdaf5b-cb43-4198-aa35-37d8f6176680', 'c297096a-784c-44c2-953a-eaaacf4718c0'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:31 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Delete snapshot completed successfully. Jul 16 11:12:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ac0abf3-6253-4d21-a4df-90064ae6e2e0 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-8aa9acf5-4348-4da6-aa95-8ada8d69f43a-delete_snapshot" released by "delete_snapshot" :: held 1.603s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Flow 'volume_create_manager' (448d5d23-4867-467a-96c2-c49279aa4534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eca907f-f571-4f0c-bc81-97793c26def7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eca907f-f571-4f0c-bc81-97793c26def7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-893745145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a535f61-cc49-4ab9-b415-1fedffb38fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5f0a4f9493464cb0606c18b83c8453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:33Z,use_quota=True,user_id='a0f9383d137c48728be9fb46ca85b476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49966537-367e-4375-a8c7-9ad64bab2b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49966537-367e-4375-a8c7-9ad64bab2b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4dfd63-a28a-4c06-8801-63c94b9c3bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4dfd63-a28a-4c06-8801-63c94b9c3bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a535f61-cc49-4ab9-b415-1fedffb38fb5', 'volume_name': 'volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917348f9-e44e-4d8d-ba79-19da94567326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (917348f9-e44e-4d8d-ba79-19da94567326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02a0568-bc5d-40eb-916b-e359428f96db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:32 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume 8a535f61-cc49-4ab9-b415-1fedffb38fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5', 'volume_size': 1} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-893745145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a535f61-cc49-4ab9-b415-1fedffb38fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5f0a4f9493464cb0606c18b83c8453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:33Z,use_quota=True,user_id='a0f9383d137c48728be9fb46ca85b476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Creating volume 8a535f61-cc49-4ab9-b415-1fedffb38fb5 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:32 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:32 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 1073741824 Jul 16 11:12:32 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:33 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 1073741824" returned: 0 in 0.449s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:33 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 Jul 16 11:12:33 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Flow 'volume_create_manager' (9fbc79dd-07df-4caf-a435-854bb0e5bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fa7280-e18d-4500-93be-2e6ce4c03d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66fa7280-e18d-4500-93be-2e6ce4c03d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1904254146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4560f1cc-6052-43c9-b6ac-ea3cdc22f67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd88971ad6a44b7b6c877bd4092cf2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:33Z,use_quota=True,user_id='b4fe933fdfa74dc38d0b0107335917a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4914016b-72a6-4a2d-bba0-7f24297c7e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4914016b-72a6-4a2d-bba0-7f24297c7e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9206a7-43c6-4be0-8fcd-884f9a461793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9206a7-43c6-4be0-8fcd-884f9a461793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4560f1cc-6052-43c9-b6ac-ea3cdc22f67e', 'volume_name': 'volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157e914a-327c-40d2-9c34-518ace14416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157e914a-327c-40d2-9c34-518ace14416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c480ca-436b-457b-a6aa-72c617990d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:33 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Volume 4560f1cc-6052-43c9-b6ac-ea3cdc22f67e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e', 'volume_size': 1} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:33 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5" returned: 0 in 0.248s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.131s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1904254146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4560f1cc-6052-43c9-b6ac-ea3cdc22f67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd88971ad6a44b7b6c877bd4092cf2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:33Z,use_quota=True,user_id='b4fe933fdfa74dc38d0b0107335917a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Creating volume 4560f1cc-6052-43c9-b6ac-ea3cdc22f67e {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:33 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02a0568-bc5d-40eb-916b-e359428f96db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:33 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e 1073741824 Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04ae26a-4cb2-41c0-bbb8-a87493b7cdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:33 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:33 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 (8a535f61-cc49-4ab9-b415-1fedffb38fb5): created successfully Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04ae26a-4cb2-41c0-bbb8-a87493b7cdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Flow 'volume_create_manager' (448d5d23-4867-467a-96c2-c49279aa4534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:33 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4a44ad5b-690c-46e8-a94e-5aa1a8ea4d07 tempest-VolumesSnapshotTestJSON-1999371902 None] Created volume successfully. Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:33 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e 1073741824" returned: 0 in 0.444s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:33 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e Jul 16 11:12:33 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:34 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.397s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] Creating offline snapshot f6fd47fe-59ff-40ca-b194-44eed7a53546 of volume 8a535f61-cc49-4ab9-b415-1fedffb38fb5 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c480ca-436b-457b-a6aa-72c617990d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aeaca7e-2018-425a-9703-b3ec6f69e84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e397979-672e-4fbc-96b8-27a59769a654]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:34 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Volume volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e (4560f1cc-6052-43c9-b6ac-ea3cdc22f67e): created successfully Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aeaca7e-2018-425a-9703-b3ec6f69e84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Flow 'volume_create_manager' (9fbc79dd-07df-4caf-a435-854bb0e5bf71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8bfc4406-2872-4004-b280-77f11b3363a8 tempest-VolumesListAdminTestJSON-1126697844 None] Created volume successfully. Jul 16 11:12:34 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 Jul 16 11:12:34 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:34 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5" returned: 0 in 0.350s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:34 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 1G Jul 16 11:12:34 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:34 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:34 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:34 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:12:34 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 1G" returned: 0 in 0.401s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:34 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 Jul 16 11:12:34 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:35 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546" returned: 0 in 0.278s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:35 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 is being set with open permissions: ugo+rw Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:35 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 Jul 16 11:12:35 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:35 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546" returned: 0 in 0.241s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:35 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.info Jul 16 11:12:35 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:35 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.info" returned: 0 in 0.272s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:35 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.info is being set with open permissions: ugo+rw Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:35 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.info Jul 16 11:12:35 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Flow 'volume_create_manager' (48ba0642-674d-4598-a088-7a4cd5b94686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cccc565-4754-493b-9754-378b6876a645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cccc565-4754-493b-9754-378b6876a645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1968784598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c8db01-09a5-477f-acf1-632f255319b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd88971ad6a44b7b6c877bd4092cf2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:36Z,use_quota=True,user_id='b4fe933fdfa74dc38d0b0107335917a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d416be6d-336d-4203-b2bc-22ae680af473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d416be6d-336d-4203-b2bc-22ae680af473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97643847-cd0a-4a3e-b599-6cb8640a34e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97643847-cd0a-4a3e-b599-6cb8640a34e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c8db01-09a5-477f-acf1-632f255319b8', 'volume_name': 'volume-f1c8db01-09a5-477f-acf1-632f255319b8', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d6cbc3-a91e-4481-af30-b6590baf8a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d6cbc3-a91e-4481-af30-b6590baf8a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f4a254-e28b-4b9c-83eb-689eda42dee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:35 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Volume f1c8db01-09a5-477f-acf1-632f255319b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c8db01-09a5-477f-acf1-632f255319b8', 'volume_size': 1} Jul 16 11:12:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:36 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.info" returned: 0 in 0.253s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.154s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1968784598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c8db01-09a5-477f-acf1-632f255319b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd88971ad6a44b7b6c877bd4092cf2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:36Z,use_quota=True,user_id='b4fe933fdfa74dc38d0b0107335917a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Creating volume f1c8db01-09a5-477f-acf1-632f255319b8 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:36 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:36 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8 1073741824 Jul 16 11:12:36 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:36 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-06993852-ff0c-45aa-8f59-5fa35a4150e2 tempest-VolumesSnapshotTestJSON-1999371902 None] Create snapshot completed successfully Jul 16 11:12:36 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8 1073741824" returned: 0 in 0.403s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:36 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8 Jul 16 11:12:36 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:36 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8" returned: 0 in 0.245s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f4a254-e28b-4b9c-83eb-689eda42dee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c8db01-09a5-477f-acf1-632f255319b8', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530a29fe-755a-4915-b26b-a35d125a135c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:36 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Volume volume-f1c8db01-09a5-477f-acf1-632f255319b8 (f1c8db01-09a5-477f-acf1-632f255319b8): created successfully Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530a29fe-755a-4915-b26b-a35d125a135c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Flow 'volume_create_manager' (48ba0642-674d-4598-a088-7a4cd5b94686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:36 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f8533e7b-f663-41a1-971b-5f701b415da5 tempest-VolumesListAdminTestJSON-1126697844 None] Created volume successfully. Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Flow 'volume_create_manager' (58d33498-0d4a-444a-b785-2163a3ea249d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7fc7f6-539b-430c-8658-ec9a81ce852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7fc7f6-539b-430c-8658-ec9a81ce852d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-440751711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afed6aff-8691-40e5-8654-e816a47b29ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5f0a4f9493464cb0606c18b83c8453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f6fd47fe-59ff-40ca-b194-44eed7a53546,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:37Z,use_quota=True,user_id='a0f9383d137c48728be9fb46ca85b476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff0509a-37e0-4a8e-84e9-b286a2f65957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff0509a-37e0-4a8e-84e9-b286a2f65957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061b2d37-ff5f-460b-8ab4-6fc8e05e72e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061b2d37-ff5f-460b-8ab4-6fc8e05e72e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'afed6aff-8691-40e5-8654-e816a47b29ef', 'volume_name': 'volume-afed6aff-8691-40e5-8654-e816a47b29ef', 'volume_size': 2, 'snapshot_id': 'f6fd47fe-59ff-40ca-b194-44eed7a53546'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94a1ec9-bae7-461b-a3c4-23da97c134f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94a1ec9-bae7-461b-a3c4-23da97c134f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69e0a71-302b-4b14-8503-1423eed1e297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:37 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Volume afed6aff-8691-40e5-8654-e816a47b29ef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-afed6aff-8691-40e5-8654-e816a47b29ef', 'volume_size': 2, 'snapshot_id': 'f6fd47fe-59ff-40ca-b194-44eed7a53546'} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-f6fd47fe-59ff-40ca-b194-44eed7a53546-afed6aff-8691-40e5-8654-e816a47b29ef" by "_create_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-f6fd47fe-59ff-40ca-b194-44eed7a53546-afed6aff-8691-40e5-8654-e816a47b29ef" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Creating volume afed6aff-8691-40e5-8654-e816a47b29ef from snapshot f6fd47fe-59ff-40ca-b194-44eed7a53546 {{(pid=87345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-afed6aff-8691-40e5-8654-e816a47b29ef" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-afed6aff-8691-40e5-8654-e816a47b29ef" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] snapshot: f6fd47fe-59ff-40ca-b194-44eed7a53546, volume: afed6aff-8691-40e5-8654-e816a47b29ef, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c20a72-d612-418e-87dd-4da0daf29272]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:37 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 Jul 16 11:12:37 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:37 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546" returned: 0 in 0.359s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[993bfd84-c161-42ab-b422-1d4e54cbd633]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:38 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 Jul 16 11:12:38 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:38 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5" returned: 0 in 0.373s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:38 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef Jul 16 11:12:38 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Flow 'volume_create_manager' (88622697-2bf7-4331-89b6-c2497a695990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e82d31-a7c7-441f-a20a-b5641c5ed4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e82d31-a7c7-441f-a20a-b5641c5ed4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1486643668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3adeda-aa6f-4feb-80bc-4c99276a19c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd88971ad6a44b7b6c877bd4092cf2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:38Z,use_quota=True,user_id='b4fe933fdfa74dc38d0b0107335917a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331e412f-415e-4835-b9a9-2a4092d74ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331e412f-415e-4835-b9a9-2a4092d74ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138ce8b7-1683-4342-97e6-e660bc6d784c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138ce8b7-1683-4342-97e6-e660bc6d784c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3adeda-aa6f-4feb-80bc-4c99276a19c5', 'volume_name': 'volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c586888-34c8-4bb9-9b26-585a13987b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c586888-34c8-4bb9-9b26-585a13987b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb84b0cb-5634-4a40-94ad-4a8a8d62dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Volume cb3adeda-aa6f-4feb-80bc-4c99276a19c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5', 'volume_size': 1} Jul 16 11:12:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:42 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef" returned: 0 in 4.079s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:42 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1ba118-28d8-44df-8993-ecd0b936cfa1]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:42 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 Jul 16 11:12:42 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:42 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5" returned: 0 in 0.551s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:42 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5, size 1024.00 MB, duration 4.08 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:12:42 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Converted 1024.00 MB image at 250.95 MB/s Jul 16 11:12:42 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef is being set with open permissions: ugo+rw Jul 16 11:12:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:42 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef Jul 16 11:12:42 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:43 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-afed6aff-8691-40e5-8654-e816a47b29ef" released by "_copy_volume_from_snapshot" :: held 5.691s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-f6fd47fe-59ff-40ca-b194-44eed7a53546-afed6aff-8691-40e5-8654-e816a47b29ef" released by "_create_volume_from_snapshot" :: held 5.719s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.734s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.758s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1486643668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3adeda-aa6f-4feb-80bc-4c99276a19c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd88971ad6a44b7b6c877bd4092cf2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:38Z,use_quota=True,user_id='b4fe933fdfa74dc38d0b0107335917a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Creating volume cb3adeda-aa6f-4feb-80bc-4c99276a19c5 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:43 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:43 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5 1073741824 Jul 16 11:12:43 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69e0a71-302b-4b14-8503-1423eed1e297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afed6aff-8691-40e5-8654-e816a47b29ef', 'volume_size': 2, 'snapshot_id': 'f6fd47fe-59ff-40ca-b194-44eed7a53546'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d16ae7e-4e29-4e5f-a1fe-a8238b275872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:43 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Volume volume-afed6aff-8691-40e5-8654-e816a47b29ef (afed6aff-8691-40e5-8654-e816a47b29ef): created successfully Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d16ae7e-4e29-4e5f-a1fe-a8238b275872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Flow 'volume_create_manager' (58d33498-0d4a-444a-b785-2163a3ea249d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:43 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-1b79bd97-eeec-4672-8f2b-23da49db89cd tempest-VolumesSnapshotTestJSON-1999371902 None] Created volume successfully. Jul 16 11:12:43 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5 1073741824" returned: 0 in 0.401s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:43 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5 Jul 16 11:12:43 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:43 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5" returned: 0 in 0.234s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb84b0cb-5634-4a40-94ad-4a8a8d62dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688d8267-ad5a-46a5-a700-2617bcf409db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:43 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Volume volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5 (cb3adeda-aa6f-4feb-80bc-4c99276a19c5): created successfully Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (688d8267-ad5a-46a5-a700-2617bcf409db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Flow 'volume_create_manager' (88622697-2bf7-4331-89b6-c2497a695990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:43 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d4cb0b6d-aeac-4c96-ba24-c3ca949fb7ca tempest-VolumesListAdminTestJSON-1126697844 None] Created volume successfully. Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-afed6aff-8691-40e5-8654-e816a47b29ef-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-afed6aff-8691-40e5-8654-e816a47b29ef-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-afed6aff-8691-40e5-8654-e816a47b29ef" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-afed6aff-8691-40e5-8654-e816a47b29ef" acquired by "delete_volume" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[772c89c2-fd9b-43a2-9fe0-04924cfe176d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:44 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef Jul 16 11:12:44 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:44 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef" returned: 0 in 0.351s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:44 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef Jul 16 11:12:44 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:44 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-afed6aff-8691-40e5-8654-e816a47b29ef" returned: 0 in 0.243s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-afed6aff-8691-40e5-8654-e816a47b29ef" released by "delete_volume" :: held 0.629s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Created reservations ['b7e59f5c-bac1-42bd-8fe7-800ca0b6f372', '2269b657-1724-4038-b757-696f6344f1f9', 'f3571855-c134-4d52-832b-64d7a48ff2ff', '88cf3327-92da-4503-9261-a4d58ffea9fd'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:44 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:44 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:45 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.273s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:45 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Deleted volume successfully. Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3473f5a-30cf-4234-aa49-be97059b5a42 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-afed6aff-8691-40e5-8654-e816a47b29ef-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-f6fd47fe-59ff-40ca-b194-44eed7a53546-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-f6fd47fe-59ff-40ca-b194-44eed7a53546-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-8a535f61-cc49-4ab9-b415-1fedffb38fb5" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-8a535f61-cc49-4ab9-b415-1fedffb38fb5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-f6fd47fe-59ff-40ca-b194-44eed7a53546" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-f6fd47fe-59ff-40ca-b194-44eed7a53546" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Deleting offline snapshot f6fd47fe-59ff-40ca-b194-44eed7a53546 of volume 8a535f61-cc49-4ab9-b415-1fedffb38fb5 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] snapshot_file for this snap is: volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[32886e06-fd73-4db7-99c1-39c02e9d7ac5]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:45 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 Jul 16 11:12:45 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Flow 'volume_create_manager' (e7df393d-cfc0-40a9-9c37-7540dee2e2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a412ba-0527-4ab1-a243-48b0db478493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:45 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a412ba-0527-4ab1-a243-48b0db478493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6c0cb7-8d0e-416b-aa09-1b40466d1d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485cfe32d584a5ebfde8d386b3120f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:46Z,use_quota=True,user_id='bb8c5de2640b4be697739b2eb0b9fd24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8171ef3-8b1b-4239-b654-170e96e9547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8171ef3-8b1b-4239-b654-170e96e9547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85412636-765b-4a8c-8070-7b30e14dd2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85412636-765b-4a8c-8070-7b30e14dd2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6c0cb7-8d0e-416b-aa09-1b40466d1d55', 'volume_name': 'volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aaa72f-d8a6-47f6-b443-b8c54b2ace50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aaa72f-d8a6-47f6-b443-b8c54b2ace50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f1f795-ec1a-4897-925b-610336ca3dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:45 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Volume dd6c0cb7-8d0e-416b-aa09-1b40466d1d55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55', 'volume_size': 1} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6c0cb7-8d0e-416b-aa09-1b40466d1d55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485cfe32d584a5ebfde8d386b3120f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:46Z,use_quota=True,user_id='bb8c5de2640b4be697739b2eb0b9fd24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Creating volume dd6c0cb7-8d0e-416b-aa09-1b40466d1d55 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:45 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546" returned: 0 in 0.440s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:12:45 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55 1073741824 Jul 16 11:12:45 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a44489-2f0f-4991-94ea-7549a4c294dd]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:45 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 Jul 16 11:12:45 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:46 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:46 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55 1073741824" returned: 0 in 0.415s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5" returned: 0 in 0.381s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:46 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 Jul 16 11:12:46 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:46 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55 Jul 16 11:12:46 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:46 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f1f795-ec1a-4897-925b-610336ca3dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9185915-af5b-4033-b5d6-82a5a33e1f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:46 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Volume volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55 (dd6c0cb7-8d0e-416b-aa09-1b40466d1d55): created successfully Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9185915-af5b-4033-b5d6-82a5a33e1f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Flow 'volume_create_manager' (e7df393d-cfc0-40a9-9c37-7540dee2e2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:46 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c80d8db0-6118-40c4-9e9e-91cbe6eaa8aa tempest-VolumesListAdminTestJSON-466708068 None] Created volume successfully. Jul 16 11:12:46 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546" returned: 0 in 0.357s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:46 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546 Jul 16 11:12:46 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Acquiring lock "cinder-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:46 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5.f6fd47fe-59ff-40ca-b194-44eed7a53546" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Lock "cinder-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-f6fd47fe-59ff-40ca-b194-44eed7a53546" released by "_delete_snapshot" :: held 1.552s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-8a535f61-cc49-4ab9-b415-1fedffb38fb5" released by "delete_snapshot" :: held 1.587s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Acquiring lock "cinder-quobyte-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Lock "cinder-quobyte-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59721c3-829c-4311-90c4-30ca7d10211a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "cinder-cb3adeda-aa6f-4feb-80bc-4c99276a19c5-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-cb3adeda-aa6f-4feb-80bc-4c99276a19c5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Created reservations ['48d85f18-5de8-4a42-b8f9-bad62bd5b92b', '5c571308-6bc8-4fa2-bf3a-11a2b0eb8164', 'ff815e79-e832-4b1b-aef3-3c44d524f209', '1ce45e3c-82df-4be2-9f99-8c207303de01'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "cinder-quobyte-cb3adeda-aa6f-4feb-80bc-4c99276a19c5" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-quobyte-cb3adeda-aa6f-4feb-80bc-4c99276a19c5" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:47 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55 Jul 16 11:12:47 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c30be4-a834-47d8-9113-8424bab357ac]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:47 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Delete snapshot completed successfully. Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-de808b29-36af-4b2d-9a48-b0e9d5ee5f76 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-f6fd47fe-59ff-40ca-b194-44eed7a53546-delete_snapshot" released by "delete_snapshot" :: held 1.843s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:47 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5 Jul 16 11:12:47 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:47 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55" returned: 0 in 0.379s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:47 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55 Jul 16 11:12:47 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:47 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5" returned: 0 in 0.377s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:47 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5 Jul 16 11:12:47 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-8a535f61-cc49-4ab9-b415-1fedffb38fb5-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-8a535f61-cc49-4ab9-b415-1fedffb38fb5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-8a535f61-cc49-4ab9-b415-1fedffb38fb5" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-8a535f61-cc49-4ab9-b415-1fedffb38fb5" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:47 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55" returned: 0 in 0.320s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Lock "cinder-quobyte-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55" released by "delete_volume" :: held 0.737s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f340e25f-78c3-4cdb-8435-73bffe2e5fd6]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Created reservations ['577ad295-d7d0-4b64-95df-9c8b4d04d0b2', '78608f38-c7a0-4410-b5e9-ec154e97a784', 'dd19b6c1-8dcd-4110-aae0-4f819bb5b37f', '04bc4d68-3e3e-4210-b00d-14662bed91fe'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:47 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cb3adeda-aa6f-4feb-80bc-4c99276a19c5" returned: 0 in 0.309s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:47 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 Jul 16 11:12:47 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-quobyte-cb3adeda-aa6f-4feb-80bc-4c99276a19c5" released by "delete_volume" :: held 0.753s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:47 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:47 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Created reservations ['53f56bbc-1cb8-4381-8e59-d1ef9943ee89', 'e05b0cf0-94d8-418b-8340-0c0272afcd1d', '87e286c0-1466-42ee-9071-a51dc6f9cb56', 'b06c65e5-7df8-4a70-bb1c-d0de01c66b2c'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:48 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:48 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:48 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:48 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5" returned: 0 in 0.393s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:48 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Deleted volume successfully. Jul 16 11:12:48 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5 Jul 16 11:12:48 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d6a4a93-5ff4-4e99-b5d0-b9ff24452660 tempest-VolumesListAdminTestJSON-466708068 None] Lock "cinder-dd6c0cb7-8d0e-416b-aa09-1b40466d1d55-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "cinder-f1c8db01-09a5-477f-acf1-632f255319b8-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:48 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.291s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:48 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Deleted volume successfully. Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-f1c8db01-09a5-477f-acf1-632f255319b8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-67630803-6d17-4a24-b2be-2b401e7d2c5c tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-cb3adeda-aa6f-4feb-80bc-4c99276a19c5-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "cinder-quobyte-f1c8db01-09a5-477f-acf1-632f255319b8" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-quobyte-f1c8db01-09a5-477f-acf1-632f255319b8" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ae5141-3844-4021-848f-11554c13970d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:48 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a535f61-cc49-4ab9-b415-1fedffb38fb5" returned: 0 in 0.290s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-8a535f61-cc49-4ab9-b415-1fedffb38fb5" released by "delete_volume" :: held 0.755s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Created reservations ['e90b0b32-a12f-4021-a47d-87523935651e', '9e1226b2-f00f-411e-9544-2a24554a1e24', '1f42b6ac-dbb9-4aa1-bbab-47532b2e7649', '0c73e244-471b-4344-9a00-8982e7deb470'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:48 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8 Jul 16 11:12:48 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:48 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:48 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:48 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8" returned: 0 in 0.374s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:48 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.256s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:48 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Deleted volume successfully. Jul 16 11:12:48 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8 Jul 16 11:12:48 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8f979825-f3fa-4d15-a09b-3fa7f5878634 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-8a535f61-cc49-4ab9-b415-1fedffb38fb5-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:49 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f1c8db01-09a5-477f-acf1-632f255319b8" returned: 0 in 0.267s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-quobyte-f1c8db01-09a5-477f-acf1-632f255319b8" released by "delete_volume" :: held 0.685s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Created reservations ['2aa29b66-02f6-4d14-af6e-741dd2e780d9', 'c6b38b90-7378-4785-aca1-7d69f0517f9f', '4032a34c-ed76-44fe-ab05-3925af82cead', 'e452ec00-d8f1-49df-a5b9-6d962302f13b'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:49 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:49 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Flow 'volume_create_manager' (f8a54bb2-101f-4e98-bd91-56f6adcef025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895bf5bf-88a8-4ff5-b8fb-ee3063d6b403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895bf5bf-88a8-4ff5-b8fb-ee3063d6b403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-957497558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5488cea9-21c4-4d91-ae4c-8eca305de11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5f0a4f9493464cb0606c18b83c8453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:49Z,use_quota=True,user_id='a0f9383d137c48728be9fb46ca85b476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3d2ece-68af-4e90-a27b-c51c6efd3255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3d2ece-68af-4e90-a27b-c51c6efd3255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a588b5a-ba3b-47fb-bfac-b6acf1ae7592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a588b5a-ba3b-47fb-bfac-b6acf1ae7592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5488cea9-21c4-4d91-ae4c-8eca305de11e', 'volume_name': 'volume-5488cea9-21c4-4d91-ae4c-8eca305de11e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32919976-dba6-4dd6-bc92-ecfd51fa2888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32919976-dba6-4dd6-bc92-ecfd51fa2888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201752ed-866f-411c-9317-df0f5f761d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:49 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume 5488cea9-21c4-4d91-ae4c-8eca305de11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5488cea9-21c4-4d91-ae4c-8eca305de11e', 'volume_size': 1} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-957497558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5488cea9-21c4-4d91-ae4c-8eca305de11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5f0a4f9493464cb0606c18b83c8453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:49Z,use_quota=True,user_id='a0f9383d137c48728be9fb46ca85b476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Creating volume 5488cea9-21c4-4d91-ae4c-8eca305de11e {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:49 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:49 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e 1073741824 Jul 16 11:12:49 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:49 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.292s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:49 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Deleted volume successfully. Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-38c00c0a-26da-454c-988f-4a03b3cae352 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-f1c8db01-09a5-477f-acf1-632f255319b8-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "cinder-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "cinder-quobyte-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-quobyte-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[981214f0-d985-449e-b3f9-e51171ee3d8b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:49 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e Jul 16 11:12:49 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:49 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e 1073741824" returned: 0 in 0.454s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:49 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e Jul 16 11:12:49 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:50 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e" returned: 0 in 0.393s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:50 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e Jul 16 11:12:50 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:50 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201752ed-866f-411c-9317-df0f5f761d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5488cea9-21c4-4d91-ae4c-8eca305de11e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779b2832-c8d0-4e13-b7d4-2717bd2fd899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:50 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume volume-5488cea9-21c4-4d91-ae4c-8eca305de11e (5488cea9-21c4-4d91-ae4c-8eca305de11e): created successfully Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779b2832-c8d0-4e13-b7d4-2717bd2fd899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Flow 'volume_create_manager' (f8a54bb2-101f-4e98-bd91-56f6adcef025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-941617b1-ef7e-49aa-8453-c8d1bc0cbec5 tempest-VolumesSnapshotTestJSON-1999371902 None] Created volume successfully. Jul 16 11:12:50 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-quobyte-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e" released by "delete_volume" :: held 0.699s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Created reservations ['6cea88e1-b803-4059-bfca-200099aefcdf', '5b442b81-bd41-46b1-b035-edf4ca5d05e1', 'bfb305f7-b585-4ec5-9bf3-f0c9c2cb5138', 'bb0a1643-0fad-4a79-a3ee-b3c8076964e2'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:50 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:12:50 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] Creating offline snapshot 887f2b89-b623-4d39-a073-0c12c2fa04c0 of volume 5488cea9-21c4-4d91-ae4c-8eca305de11e {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[574a763d-b679-43b4-b0b2-6a121b77274b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:50 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e Jul 16 11:12:50 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:50 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.256s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:12:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Deleted volume successfully. Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2e04d65a-8745-49ab-a1f1-cb56814487a8 tempest-VolumesListAdminTestJSON-1126697844 None] Lock "cinder-4560f1cc-6052-43c9-b6ac-ea3cdc22f67e-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:50 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e" returned: 0 in 0.375s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:50 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 1G Jul 16 11:12:50 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:51 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 1G" returned: 0 in 0.399s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5488cea9-21c4-4d91-ae4c-8eca305de11e -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:51 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5488cea9-21c4-4d91-ae4c-8eca305de11e -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 Jul 16 11:12:51 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:51 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5488cea9-21c4-4d91-ae4c-8eca305de11e -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0" returned: 0 in 0.302s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:51 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 is being set with open permissions: ugo+rw Jul 16 11:12:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:51 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 Jul 16 11:12:51 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:51 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0" returned: 0 in 0.259s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:51 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.info Jul 16 11:12:51 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:52 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.info" returned: 0 in 0.288s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:52 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.info is being set with open permissions: ugo+rw Jul 16 11:12:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:52 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.info Jul 16 11:12:52 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:52 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.info" returned: 0 in 0.261s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:52 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-209d782d-9090-4441-99aa-57f4bf4d6bdf tempest-VolumesSnapshotTestJSON-1999371902 None] Create snapshot completed successfully Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Flow 'volume_create_manager' (1458704d-c466-41f9-9dcc-91ea2c238213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3afe96-3ddf-43b6-99a3-b091945cccb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3afe96-3ddf-43b6-99a3-b091945cccb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1022414108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6881eb0f-e625-40ac-b886-3e8fae4373c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d5f0a4f9493464cb0606c18b83c8453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=887f2b89-b623-4d39-a073-0c12c2fa04c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:53Z,use_quota=True,user_id='a0f9383d137c48728be9fb46ca85b476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9741585f-d488-4e2b-b33c-ebdbc54ea114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9741585f-d488-4e2b-b33c-ebdbc54ea114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54722f96-277e-4725-a058-b55294103ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54722f96-277e-4725-a058-b55294103ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6881eb0f-e625-40ac-b886-3e8fae4373c8', 'volume_name': 'volume-6881eb0f-e625-40ac-b886-3e8fae4373c8', 'volume_size': 1, 'snapshot_id': '887f2b89-b623-4d39-a073-0c12c2fa04c0'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4eb64c-872d-470a-b7d8-f33995ecaf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4eb64c-872d-470a-b7d8-f33995ecaf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be8c6b1-5634-4c34-adfe-e1a0fc9e5ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:53 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume 6881eb0f-e625-40ac-b886-3e8fae4373c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6881eb0f-e625-40ac-b886-3e8fae4373c8', 'volume_size': 1, 'snapshot_id': '887f2b89-b623-4d39-a073-0c12c2fa04c0'} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-887f2b89-b623-4d39-a073-0c12c2fa04c0-6881eb0f-e625-40ac-b886-3e8fae4373c8" by "_create_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-887f2b89-b623-4d39-a073-0c12c2fa04c0-6881eb0f-e625-40ac-b886-3e8fae4373c8" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Creating volume 6881eb0f-e625-40ac-b886-3e8fae4373c8 from snapshot 887f2b89-b623-4d39-a073-0c12c2fa04c0 {{(pid=87345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-6881eb0f-e625-40ac-b886-3e8fae4373c8" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-6881eb0f-e625-40ac-b886-3e8fae4373c8" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] snapshot: 887f2b89-b623-4d39-a073-0c12c2fa04c0, volume: 6881eb0f-e625-40ac-b886-3e8fae4373c8, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a1a465-4582-466f-9504-d1fd460e11ff]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:53 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 Jul 16 11:12:53 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:53 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0" returned: 0 in 0.375s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5488cea9-21c4-4d91-ae4c-8eca305de11e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af8dce2-7cc3-42da-9f3e-026b2567622f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:53 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e Jul 16 11:12:53 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:54 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e" returned: 0 in 0.421s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:54 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:12:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:54 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 Jul 16 11:12:54 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:55 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:12:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Flow 'volume_create_manager' (593ae112-3368-4dd2-8428-9bfb9fa6129d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a883fc1-b13a-450c-af55-bcf5745c996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a883fc1-b13a-450c-af55-bcf5745c996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1326154918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc490c36-1a4a-429a-8e98-0c3117089868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d679da165ba46dcbd12c296650901be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:55Z,use_quota=True,user_id='262fc369f0ec4cdbb7b15983fe3d0a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b46dea6-8892-41a6-a175-7ff0cbaf2fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b46dea6-8892-41a6-a175-7ff0cbaf2fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89ddc3f-5b02-4f0d-b611-893c7c3a339f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:55 devstack cinder-volume[87345]: DEBUG cinder.image.glance [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Creating Keystone auth plugin from conf {{(pid=87345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 11:12:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89ddc3f-5b02-4f0d-b611-893c7c3a339f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fc490c36-1a4a-429a-8e98-0c3117089868', 'volume_name': 'volume-fc490c36-1a4a-429a-8e98-0c3117089868', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f3ba04-f7df-4c02-bc61-3dcd7736e14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f3ba04-f7df-4c02-bc61-3dcd7736e14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f08f50-848c-4eb0-963c-3793149bfdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:56 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Volume fc490c36-1a4a-429a-8e98-0c3117089868: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fc490c36-1a4a-429a-8e98-0c3117089868', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 11:12:56 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Trying to clone fc490c36-1a4a-429a-8e98-0c3117089868 from image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f at location (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]). {{(pid=87345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 11:12:56 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 11:12:56 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Image download 20.69 MB at 20.69 MB/s Jul 16 11:12:56 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f59a36-f187-4c41-80ef-339f70d025fd]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:56 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD Jul 16 11:12:56 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:57 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD" returned: 0 in 0.545s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:57 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Temporary image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f is fetched for user 262fc369f0ec4cdbb7b15983fe3d0a45. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 11:12:57 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[957ba523-79a1-4bbb-8c25-2d1deeeff898]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:57 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD Jul 16 11:12:57 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:58 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:58 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8" returned: 0 in 4.683s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:58 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6908a0-09f2-4806-a1b8-c579b739fbb3]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:12:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:58 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e Jul 16 11:12:58 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:59 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e" returned: 0 in 0.532s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:12:59 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Converted 1024.00 MB image at 218.61 MB/s Jul 16 11:12:59 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 is being set with open permissions: ugo+rw Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:59 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 Jul 16 11:12:59 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:59 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8" returned: 0 in 0.239s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-6881eb0f-e625-40ac-b886-3e8fae4373c8" released by "_copy_volume_from_snapshot" :: held 6.338s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-887f2b89-b623-4d39-a073-0c12c2fa04c0-6881eb0f-e625-40ac-b886-3e8fae4373c8" released by "_create_volume_from_snapshot" :: held 6.373s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.389s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.386s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1326154918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc490c36-1a4a-429a-8e98-0c3117089868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d679da165ba46dcbd12c296650901be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:12:55Z,use_quota=True,user_id='262fc369f0ec4cdbb7b15983fe3d0a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Creating volume fc490c36-1a4a-429a-8e98-0c3117089868 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:12:59 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:12:59 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 1073741824 Jul 16 11:12:59 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be8c6b1-5634-4c34-adfe-e1a0fc9e5ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6881eb0f-e625-40ac-b886-3e8fae4373c8', 'volume_size': 1, 'snapshot_id': '887f2b89-b623-4d39-a073-0c12c2fa04c0'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a20aead-89d2-486e-b758-26c3878f69bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:12:59 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Volume volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 (6881eb0f-e625-40ac-b886-3e8fae4373c8): created successfully Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a20aead-89d2-486e-b758-26c3878f69bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:12:59 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Flow 'volume_create_manager' (1458704d-c466-41f9-9dcc-91ea2c238213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:12:59 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-933a9f42-599e-4ffa-a47b-f7c42f789827 tempest-VolumesSnapshotTestJSON-1999371902 None] Created volume successfully. Jul 16 11:13:00 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 1073741824" returned: 0 in 0.408s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:00 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 Jul 16 11:13:00 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:00 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868" returned: 0 in 0.241s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Attempting download of 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f ((None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}])) to volume fc490c36-1a4a-429a-8e98-0c3117089868. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[168f249b-c756-4ad3-afb5-9cb38df52b3c]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f__0voglcf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:00 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f__0voglcf Jul 16 11:13:00 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:00 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f__0voglcf" returned: 0 in 0.317s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f__0voglcf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:00 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f__0voglcf Jul 16 11:13:00 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-6881eb0f-e625-40ac-b886-3e8fae4373c8-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-6881eb0f-e625-40ac-b886-3e8fae4373c8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-6881eb0f-e625-40ac-b886-3e8fae4373c8" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-6881eb0f-e625-40ac-b886-3e8fae4373c8" acquired by "delete_volume" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3769bb-e73c-4e87-a920-a59bfe6d63ba]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:01 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f__0voglcf" returned: 1 in 0.340s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f__0voglcf' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[13752dfe-95f5-42f6-ba6c-3271cae1295f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:01 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 Jul 16 11:13:01 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:01 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD Jul 16 11:13:01 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:01 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8" returned: 0 in 0.355s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:01 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f was qcow2, converting to qcow2 {{(pid=87345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:01 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8 Jul 16 11:13:01 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:01 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 Jul 16 11:13:01 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:01 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6881eb0f-e625-40ac-b886-3e8fae4373c8" returned: 0 in 0.251s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-6881eb0f-e625-40ac-b886-3e8fae4373c8" released by "delete_volume" :: held 0.651s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Created reservations ['a1d51084-42f1-42c7-91ec-0ce9d2df0b60', '4cb46e9d-2aa2-4ab6-b5be-2007a19a083f', '11ee0049-8e00-46ad-9035-700580eb5f12', 'aecd66bc-9e43-4ef4-b094-90c332ad6872'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:01 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:13:01 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:01 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.259s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:01 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:13:01 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Deleted volume successfully. Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c00b4b38-dd64-4021-8fba-622461d4beb6 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-6881eb0f-e625-40ac-b886-3e8fae4373c8-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-887f2b89-b623-4d39-a073-0c12c2fa04c0-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-887f2b89-b623-4d39-a073-0c12c2fa04c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-5488cea9-21c4-4d91-ae4c-8eca305de11e" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-5488cea9-21c4-4d91-ae4c-8eca305de11e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-887f2b89-b623-4d39-a073-0c12c2fa04c0" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-887f2b89-b623-4d39-a073-0c12c2fa04c0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Deleting offline snapshot 887f2b89-b623-4d39-a073-0c12c2fa04c0 of volume 5488cea9-21c4-4d91-ae4c-8eca305de11e {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] snapshot_file for this snap is: volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a94282-59bf-4643-a498-1201119a094a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:02 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 Jul 16 11:13:02 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:02 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0" returned: 0 in 0.407s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5488cea9-21c4-4d91-ae4c-8eca305de11e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08ef704-5c21-43a4-97dc-f0d813b33f54]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:02 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e Jul 16 11:13:02 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:03 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868" returned: 0 in 1.645s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_y72faeevdevstack@QuobyteHD, size 112.00 MB, duration 1.65 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:13:03 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Converted 112.00 MB image at 68.04 MB/s Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:03 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e" returned: 0 in 0.385s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:03 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 1G Jul 16 11:13:03 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:03 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 Jul 16 11:13:03 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:03 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 1G" returned: 0 in 0.332s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Downloaded image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f ((None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}])) to volume fc490c36-1a4a-429a-8e98-0c3117089868 successfully. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Temporary image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f for user 262fc369f0ec4cdbb7b15983fe3d0a45 is deleted. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Marking volume fc490c36-1a4a-429a-8e98-0c3117089868 as bootable. {{(pid=87345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Copying metadata from image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f to fc490c36-1a4a-429a-8e98-0c3117089868. {{(pid=87345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Creating volume glance metadata for volume fc490c36-1a4a-429a-8e98-0c3117089868 backed by image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 11:13:03 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0" returned: 0 in 0.334s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:03 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0 Jul 16 11:13:03 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f08f50-848c-4eb0-963c-3793149bfdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc490c36-1a4a-429a-8e98-0c3117089868', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a95d162-cb26-4caf-941f-450eefcabd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:03 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Volume volume-fc490c36-1a4a-429a-8e98-0c3117089868 (fc490c36-1a4a-429a-8e98-0c3117089868): created successfully Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a95d162-cb26-4caf-941f-450eefcabd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Flow 'volume_create_manager' (593ae112-3368-4dd2-8428-9bfb9fa6129d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:13:03 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-006556bd-225b-4a90-b977-9441f4e745d6 tempest-VolumesImageMetadata-1471415436 None] Created volume successfully. Jul 16 11:13:03 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e.887f2b89-b623-4d39-a073-0c12c2fa04c0" returned: 0 in 0.245s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-887f2b89-b623-4d39-a073-0c12c2fa04c0" released by "_delete_snapshot" :: held 1.506s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-5488cea9-21c4-4d91-ae4c-8eca305de11e" released by "delete_snapshot" :: held 1.529s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Created reservations ['6badb338-5d24-4b90-9de9-893d3e14d0e3', '450ad89c-3f7e-4de4-968c-4b5ac0593e83', 'b9250a96-418b-4387-ac21-4f74cc60791f', '1c8c4f1d-ae5b-4077-aed9-d0268ddaf259'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:13:03 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Delete snapshot completed successfully. Jul 16 11:13:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7cfb4048-6a7a-4a98-9853-caed2ebab08e tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-887f2b89-b623-4d39-a073-0c12c2fa04c0-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Acquiring lock "cinder-fc490c36-1a4a-429a-8e98-0c3117089868-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Lock "cinder-fc490c36-1a4a-429a-8e98-0c3117089868-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Acquiring lock "cinder-quobyte-fc490c36-1a4a-429a-8e98-0c3117089868" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Lock "cinder-quobyte-fc490c36-1a4a-429a-8e98-0c3117089868" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d3be10-16c8-4bc6-bd54-3193fb509ad3]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:04 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 Jul 16 11:13:04 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-5488cea9-21c4-4d91-ae4c-8eca305de11e-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-5488cea9-21c4-4d91-ae4c-8eca305de11e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-5488cea9-21c4-4d91-ae4c-8eca305de11e" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-5488cea9-21c4-4d91-ae4c-8eca305de11e" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef3f756-f15c-49cd-adf8-4edfa057b4a0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:04 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868" returned: 0 in 0.372s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:04 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868 Jul 16 11:13:04 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:04 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e Jul 16 11:13:04 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:04 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-fc490c36-1a4a-429a-8e98-0c3117089868" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Lock "cinder-quobyte-fc490c36-1a4a-429a-8e98-0c3117089868" released by "delete_volume" :: held 0.649s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Created reservations ['6fec8de9-ffd9-4eec-be90-afc8788d02ac', '781821a7-9b39-44f7-9d9a-ab6e0019cfb4', 'ce8621c1-c7b4-491d-afd5-bc1f5c52c570', '854d6f37-b366-40b9-8831-c4707406d687'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:13:04 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e" returned: 0 in 0.369s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:04 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e Jul 16 11:13:04 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:04 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:13:04 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:05 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5488cea9-21c4-4d91-ae4c-8eca305de11e" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-5488cea9-21c4-4d91-ae4c-8eca305de11e" released by "delete_volume" :: held 0.682s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Created reservations ['0fd995f5-31fc-4ec3-9de7-e34c519ea282', 'd99fc815-3c38-4c99-bdd2-dcd3659033fc', '017f1282-5ca0-4b5f-8dcc-32219d343c8c', '2ddc8364-d3ab-40d6-a385-d9acdbd617e0'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:13:05 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:13:05 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Deleted volume successfully. Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b82453ad-5378-4da1-8178-325953be7409 tempest-VolumesImageMetadata-1471415436 None] Lock "cinder-fc490c36-1a4a-429a-8e98-0c3117089868-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:05 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:13:05 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:05 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.267s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:13:05 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Deleted volume successfully. Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-1cf13594-66ec-4966-b5cf-cc2312087b34 tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-5488cea9-21c4-4d91-ae4c-8eca305de11e-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-17aec0d6-5268-4b73-9abf-cb22d2d6eee1-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-17aec0d6-5268-4b73-9abf-cb22d2d6eee1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "cinder-quobyte-17aec0d6-5268-4b73-9abf-cb22d2d6eee1" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-17aec0d6-5268-4b73-9abf-cb22d2d6eee1" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5267900-dcdc-409d-901d-6b477534e9b5]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:05 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 Jul 16 11:13:05 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:06 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1" returned: 0 in 0.395s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:06 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1 Jul 16 11:13:06 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:06 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-17aec0d6-5268-4b73-9abf-cb22d2d6eee1" returned: 0 in 0.261s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-quobyte-17aec0d6-5268-4b73-9abf-cb22d2d6eee1" released by "delete_volume" :: held 0.732s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Created reservations ['1baa2d15-2dd0-4740-91e4-20dd5fce9389', '7e5a26cf-1746-4914-9d0e-ab903562384c', '0beb662e-de33-44ce-b1c3-e527f6b76197', '87fbead3-1779-41c8-b095-c1471d411d86'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:06 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:13:06 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:06 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:13:06 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Deleted volume successfully. Jul 16 11:13:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f123c874-8e99-460c-a95a-7df565ac5e2f tempest-VolumesSnapshotTestJSON-1999371902 None] Lock "cinder-17aec0d6-5268-4b73-9abf-cb22d2d6eee1-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Flow 'volume_create_manager' (204ea87b-44b3-445d-99d8-8f2c0fac33c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1b7db3-9b58-4dcf-ab30-1a6b3b8e7e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1b7db3-9b58-4dcf-ab30-1a6b3b8e7e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-988575985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8854d2fb-d0e1-4216-a735-78bc6305b82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8094a57e494f5aa8e365afa46c28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:13:08Z,use_quota=True,user_id='faf354fe0d8447a684ee4f688602cc34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a1d511-a206-4ff6-b60d-52404ba51ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a1d511-a206-4ff6-b60d-52404ba51ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1452c79a-a002-43ed-9b62-19ffe36e4304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.image.glance [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Creating Keystone auth plugin from conf {{(pid=87345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1452c79a-a002-43ed-9b62-19ffe36e4304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8854d2fb-d0e1-4216-a735-78bc6305b82c', 'volume_name': 'volume-8854d2fb-d0e1-4216-a735-78bc6305b82c', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257bb191-e852-4412-8078-f9837a83c53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257bb191-e852-4412-8078-f9837a83c53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfacceb-0700-4c84-a17d-5f1e676b2309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Volume 8854d2fb-d0e1-4216-a735-78bc6305b82c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8854d2fb-d0e1-4216-a735-78bc6305b82c', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Trying to clone 8854d2fb-d0e1-4216-a735-78bc6305b82c from image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f at location (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]). {{(pid=87345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 11:13:08 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 11:13:08 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Image download 20.69 MB at 20.69 MB/s Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c92277a-31fa-480d-9233-9d94b29bd45c]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:09 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD Jul 16 11:13:09 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:09 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Temporary image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f is fetched for user faf354fe0d8447a684ee4f688602cc34. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f701ea9-3341-4208-a3d3-220a16519a7a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:09 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD Jul 16 11:13:09 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:09 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-988575985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8854d2fb-d0e1-4216-a735-78bc6305b82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8094a57e494f5aa8e365afa46c28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:13:08Z,use_quota=True,user_id='faf354fe0d8447a684ee4f688602cc34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Creating volume 8854d2fb-d0e1-4216-a735-78bc6305b82c {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:13:09 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:13:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:09 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c 1073741824 Jul 16 11:13:09 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:10 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c 1073741824" returned: 0 in 0.431s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:10 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c Jul 16 11:13:10 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:10 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c" returned: 0 in 0.248s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:13:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:10 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Attempting download of 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f ((None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}])) to volume 8854d2fb-d0e1-4216-a735-78bc6305b82c. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 11:13:10 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2905f56c-f4ab-4ac3-bdf0-d147cfb84cd1]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_513nzw11 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:10 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_513nzw11 Jul 16 11:13:10 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:10 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_513nzw11" returned: 0 in 0.373s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_513nzw11 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:11 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_513nzw11 Jul 16 11:13:11 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:11 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_513nzw11" returned: 1 in 0.337s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_513nzw11' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:13:11 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c8dc04-1e5b-45f0-b890-59c7c6955170]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:11 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD Jul 16 11:13:11 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:11 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:11 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f was qcow2, converting to qcow2 {{(pid=87345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 11:13:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:11 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c Jul 16 11:13:11 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:13 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c" returned: 0 in 1.717s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_0kyox7v_devstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:13:13 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Converted 112.00 MB image at 65.06 MB/s Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:13 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c 1G Jul 16 11:13:13 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:13 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c 1G" returned: 0 in 0.357s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Downloaded image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f ((None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}])) to volume 8854d2fb-d0e1-4216-a735-78bc6305b82c successfully. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Temporary image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f for user faf354fe0d8447a684ee4f688602cc34 is deleted. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Marking volume 8854d2fb-d0e1-4216-a735-78bc6305b82c as bootable. {{(pid=87345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Copying metadata from image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f to 8854d2fb-d0e1-4216-a735-78bc6305b82c. {{(pid=87345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Creating volume glance metadata for volume 8854d2fb-d0e1-4216-a735-78bc6305b82c backed by image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfacceb-0700-4c84-a17d-5f1e676b2309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8854d2fb-d0e1-4216-a735-78bc6305b82c', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfda79c8-72dc-4cf5-8adb-80f2544ee246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:13 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Volume volume-8854d2fb-d0e1-4216-a735-78bc6305b82c (8854d2fb-d0e1-4216-a735-78bc6305b82c): created successfully Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfda79c8-72dc-4cf5-8adb-80f2544ee246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Flow 'volume_create_manager' (204ea87b-44b3-445d-99d8-8f2c0fac33c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:13:13 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-26d9bec6-9b16-4f8e-8033-0b29e50c7d5e tempest-VolumesExtendTest-1462790495 None] Created volume successfully. Jul 16 11:13:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-80875ec4-b81b-4fe2-a152-5f5f859d42c5 tempest-VolumesExtendTest-1462790495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-80875ec4-b81b-4fe2-a152-5f5f859d42c5 tempest-VolumesExtendTest-1462790495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:14 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[252361f2-e527-4016-a20d-2ad54cdb86d3]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-80875ec4-b81b-4fe2-a152-5f5f859d42c5 tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:14 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c Jul 16 11:13:14 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:15 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-80875ec4-b81b-4fe2-a152-5f5f859d42c5 tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c" returned: 0 in 0.379s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-80875ec4-b81b-4fe2-a152-5f5f859d42c5 tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c 2G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-80875ec4-b81b-4fe2-a152-5f5f859d42c5 tempest-VolumesExtendTest-1462790495 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c 2G" returned: 0 in 0.090s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-80875ec4-b81b-4fe2-a152-5f5f859d42c5 tempest-VolumesExtendTest-1462790495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.493s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-80875ec4-b81b-4fe2-a152-5f5f859d42c5 tempest-VolumesExtendTest-1462790495 None] Extend volume completed successfully. Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Acquiring lock "cinder-8854d2fb-d0e1-4216-a735-78bc6305b82c-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Lock "cinder-8854d2fb-d0e1-4216-a735-78bc6305b82c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Acquiring lock "cinder-quobyte-8854d2fb-d0e1-4216-a735-78bc6305b82c" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Lock "cinder-quobyte-8854d2fb-d0e1-4216-a735-78bc6305b82c" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f175fb2-2294-4d49-862a-c76ea8477010]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:16 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c Jul 16 11:13:16 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:16 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c" returned: 0 in 0.352s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:16 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c Jul 16 11:13:16 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:16 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8854d2fb-d0e1-4216-a735-78bc6305b82c" returned: 0 in 0.251s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Lock "cinder-quobyte-8854d2fb-d0e1-4216-a735-78bc6305b82c" released by "delete_volume" :: held 0.642s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Created reservations ['c206ca16-bd5b-41db-b96e-1216835d0689', 'c704c149-c59a-4fd8-a4cc-b0915ea26fb1', '7e850bc3-a9bb-4c8a-9ed3-fb31c821991f', '6f44c278-77be-4489-9605-d854b80f7dc5'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:17 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:13:17 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:17 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.319s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:13:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Deleted volume successfully. Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5748fc83-732c-4efe-873d-7ca83582d81e tempest-VolumesExtendTest-1462790495 None] Lock "cinder-8854d2fb-d0e1-4216-a735-78bc6305b82c-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:DELETE=15,cinder:SELECT=141,cinder:UPDATE=160,cinder:INSERT=50 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Flow 'volume_create_manager' (ec899a59-3dba-4701-9cdd-a6d4dae318f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba2450c-00e6-43b6-9038-61c89995305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba2450c-00e6-43b6-9038-61c89995305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2004888830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d0f916-3576-41a9-836e-48151e3900c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8094a57e494f5aa8e365afa46c28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:13:18Z,use_quota=True,user_id='faf354fe0d8447a684ee4f688602cc34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d42ab7-d182-4620-bf81-6734950f7fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d42ab7-d182-4620-bf81-6734950f7fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe30caa-f886-406b-b07e-c15fc4bf6814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe30caa-f886-406b-b07e-c15fc4bf6814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d0f916-3576-41a9-836e-48151e3900c4', 'volume_name': 'volume-e5d0f916-3576-41a9-836e-48151e3900c4', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acf8877-190c-4178-9a01-0cee60ab059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acf8877-190c-4178-9a01-0cee60ab059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f4bf0c-2e70-4ee0-802e-98405c882aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:17 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Volume e5d0f916-3576-41a9-836e-48151e3900c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d0f916-3576-41a9-836e-48151e3900c4', 'volume_size': 1} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2004888830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5d0f916-3576-41a9-836e-48151e3900c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8094a57e494f5aa8e365afa46c28fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:13:18Z,use_quota=True,user_id='faf354fe0d8447a684ee4f688602cc34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Creating volume e5d0f916-3576-41a9-836e-48151e3900c4 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:13:17 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:13:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:17 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 1073741824 Jul 16 11:13:17 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:18 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 1073741824" returned: 0 in 0.453s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:18 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 Jul 16 11:13:18 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:18 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4" returned: 0 in 0.256s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:13:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f4bf0c-2e70-4ee0-802e-98405c882aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d0f916-3576-41a9-836e-48151e3900c4', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209bf068-acb1-4ff7-a8f0-b544907f8322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:18 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Volume volume-e5d0f916-3576-41a9-836e-48151e3900c4 (e5d0f916-3576-41a9-836e-48151e3900c4): created successfully Jul 16 11:13:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209bf068-acb1-4ff7-a8f0-b544907f8322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Flow 'volume_create_manager' (ec899a59-3dba-4701-9cdd-a6d4dae318f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:13:18 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-beb55f2c-3971-4c34-a138-d791074ee3d1 tempest-VolumesExtendTest-1462790495 None] Created volume successfully. Jul 16 11:13:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] Creating offline snapshot b34b993f-9e6b-41c7-bb83-d6d62844beae of volume e5d0f916-3576-41a9-836e-48151e3900c4 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:13:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1965af7-9980-49e5-b8c3-8acb31da93e0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:20 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 Jul 16 11:13:20 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:20 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4" returned: 0 in 0.380s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:20 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae 1G Jul 16 11:13:20 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:20 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae 1G" returned: 0 in 0.456s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d0f916-3576-41a9-836e-48151e3900c4 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:20 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d0f916-3576-41a9-836e-48151e3900c4 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae Jul 16 11:13:20 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:21 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5d0f916-3576-41a9-836e-48151e3900c4 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae" returned: 0 in 0.336s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:21 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae is being set with open permissions: ugo+rw Jul 16 11:13:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:21 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae Jul 16 11:13:21 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:21 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae" returned: 0 in 0.265s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:21 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.info Jul 16 11:13:21 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:21 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.info" returned: 0 in 0.286s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:21 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.info is being set with open permissions: ugo+rw Jul 16 11:13:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:21 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.info Jul 16 11:13:21 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:22 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.info" returned: 0 in 0.261s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:22 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c99633ff-3c59-4c2b-bd25-0ff015c2e08e tempest-VolumesExtendTest-1462790495 None] Create snapshot completed successfully Jul 16 11:13:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b658d70-32bf-43a2-b28c-7b2219b1391d tempest-VolumesExtendTest-1462790495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b658d70-32bf-43a2-b28c-7b2219b1391d tempest-VolumesExtendTest-1462790495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:23 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c12956-0350-4987-a0c0-2769bce8b9b4]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b658d70-32bf-43a2-b28c-7b2219b1391d tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:23 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 Jul 16 11:13:23 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:23 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b658d70-32bf-43a2-b28c-7b2219b1391d tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4" returned: 0 in 0.380s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b658d70-32bf-43a2-b28c-7b2219b1391d tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae 2G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1b658d70-32bf-43a2-b28c-7b2219b1391d tempest-VolumesExtendTest-1462790495 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae 2G" returned: 0 in 0.123s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1b658d70-32bf-43a2-b28c-7b2219b1391d tempest-VolumesExtendTest-1462790495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.541s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:23 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-1b658d70-32bf-43a2-b28c-7b2219b1391d tempest-VolumesExtendTest-1462790495 None] Extend volume completed successfully. Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Acquiring lock "cinder-b34b993f-9e6b-41c7-bb83-d6d62844beae-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Lock "cinder-b34b993f-9e6b-41c7-bb83-d6d62844beae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Acquiring lock "cinder-quobyte-e5d0f916-3576-41a9-836e-48151e3900c4" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Lock "cinder-quobyte-e5d0f916-3576-41a9-836e-48151e3900c4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Acquiring lock "cinder-quobyte-b34b993f-9e6b-41c7-bb83-d6d62844beae" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Lock "cinder-quobyte-b34b993f-9e6b-41c7-bb83-d6d62844beae" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Deleting offline snapshot b34b993f-9e6b-41c7-bb83-d6d62844beae of volume e5d0f916-3576-41a9-836e-48151e3900c4 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] snapshot_file for this snap is: volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fa8cbf-3e75-4f75-b7cf-6a2f74a3f62b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:24 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae Jul 16 11:13:24 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:24 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae" returned: 0 in 0.377s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5d0f916-3576-41a9-836e-48151e3900c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:13:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e799bc7-31fc-4e4a-baea-fcbcdc329ea9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:25 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 Jul 16 11:13:25 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:25 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4" returned: 0 in 0.384s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:25 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae Jul 16 11:13:25 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:25 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae" returned: 0 in 0.358s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:25 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae Jul 16 11:13:25 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:26 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4.b34b993f-9e6b-41c7-bb83-d6d62844beae" returned: 0 in 0.258s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Lock "cinder-quobyte-b34b993f-9e6b-41c7-bb83-d6d62844beae" released by "_delete_snapshot" :: held 1.496s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Lock "cinder-quobyte-e5d0f916-3576-41a9-836e-48151e3900c4" released by "delete_snapshot" :: held 1.519s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:26 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Created reservations ['596a985f-8ffd-4b52-85b2-ee629928c8ca', '89be6161-4a76-42bb-a738-1fb15c6c2d45', 'f8a1ff86-9d99-47b7-aeff-175956705878', 'e04cf6a4-ca5e-4f73-bb53-ddb30ed173bd'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:13:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Delete snapshot completed successfully. Jul 16 11:13:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-baefb153-bc45-4aba-87c0-962c832d323a tempest-VolumesExtendTest-1462790495 None] Lock "cinder-b34b993f-9e6b-41c7-bb83-d6d62844beae-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Acquiring lock "cinder-e5d0f916-3576-41a9-836e-48151e3900c4-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Lock "cinder-e5d0f916-3576-41a9-836e-48151e3900c4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Acquiring lock "cinder-quobyte-e5d0f916-3576-41a9-836e-48151e3900c4" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Lock "cinder-quobyte-e5d0f916-3576-41a9-836e-48151e3900c4" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:26 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c9d848-0214-4fc7-9321-262011858aff]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:26 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 Jul 16 11:13:26 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:27 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4" returned: 0 in 0.358s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:27 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4 Jul 16 11:13:27 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:27 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e5d0f916-3576-41a9-836e-48151e3900c4" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Lock "cinder-quobyte-e5d0f916-3576-41a9-836e-48151e3900c4" released by "delete_volume" :: held 0.676s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Created reservations ['12777ceb-420d-4e90-9355-1a74a0a6d27f', '8912557e-3ab1-466b-ba6f-754da1e62cca', 'e4fdddf7-1c09-48c3-a94b-2bbe29e716df', '18e86074-67e3-4c29-a4c1-bc06efc03a89'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:27 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:13:27 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:27 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.260s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:13:27 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Deleted volume successfully. Jul 16 11:13:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c44dd4a6-e2df-4f78-8948-3b0cb0ad7f7e tempest-VolumesExtendTest-1462790495 None] Lock "cinder-e5d0f916-3576-41a9-836e-48151e3900c4-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=133,cinder:DELETE=11,cinder:UPDATE=158,cinder:INSERT=51 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Flow 'volume_create_manager' (71b5e1b4-7ab2-4507-94fb-31e31d299939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ba7528-1faf-4fe1-9873-5d9ea0ea3450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ba7528-1faf-4fe1-9873-5d9ea0ea3450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1029178523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd296078-5d44-4957-aa7a-c9148f056b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14c447135a9425b8c065002790a02f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:13:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:13:31Z,use_quota=True,user_id='412e201d46354bf6a7567d93684706de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4092ae-b10c-4433-ad7c-3e65d69f04bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4092ae-b10c-4433-ad7c-3e65d69f04bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2832c74d-c110-40b9-8d9a-c02bccc37b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2832c74d-c110-40b9-8d9a-c02bccc37b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd296078-5d44-4957-aa7a-c9148f056b5b', 'volume_name': 'volume-cd296078-5d44-4957-aa7a-c9148f056b5b', 'volume_size': 2}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d668d9-84c2-4f80-b77f-10ad9174e186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d668d9-84c2-4f80-b77f-10ad9174e186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0d2e8d-7323-4769-a9aa-cbe95e5e44a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:31 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Volume cd296078-5d44-4957-aa7a-c9148f056b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd296078-5d44-4957-aa7a-c9148f056b5b', 'volume_size': 2} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1029178523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd296078-5d44-4957-aa7a-c9148f056b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14c447135a9425b8c065002790a02f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:13:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:13:31Z,use_quota=True,user_id='412e201d46354bf6a7567d93684706de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Creating volume cd296078-5d44-4957-aa7a-c9148f056b5b {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:13:31 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b 2147483648 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:31 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b 2147483648 Jul 16 11:13:31 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:31 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b 2147483648" returned: 0 in 0.543s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:31 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b Jul 16 11:13:31 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:32 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:13:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0d2e8d-7323-4769-a9aa-cbe95e5e44a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd296078-5d44-4957-aa7a-c9148f056b5b', 'volume_size': 2}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3861f40d-ceac-4d3d-a5c6-3986b4390901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:32 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Volume volume-cd296078-5d44-4957-aa7a-c9148f056b5b (cd296078-5d44-4957-aa7a-c9148f056b5b): created successfully Jul 16 11:13:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3861f40d-ceac-4d3d-a5c6-3986b4390901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Flow 'volume_create_manager' (71b5e1b4-7ab2-4507-94fb-31e31d299939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:13:32 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-0d4f8925-cdbf-4ed6-aaa4-b831291de0b4 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Created volume successfully. Jul 16 11:13:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Creating offline snapshot ef1cf14d-b297-478b-9ce0-2333e3fbf47f of volume cd296078-5d44-4957-aa7a-c9148f056b5b {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:13:33 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc6e4c-498d-4c0c-9498-ee9053d83dcb]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:33 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b Jul 16 11:13:33 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:33 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b" returned: 0 in 0.380s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f 2G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:33 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f 2G Jul 16 11:13:33 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:34 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f 2G" returned: 0 in 0.422s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd296078-5d44-4957-aa7a-c9148f056b5b -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:34 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd296078-5d44-4957-aa7a-c9148f056b5b -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f Jul 16 11:13:34 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:34 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd296078-5d44-4957-aa7a-c9148f056b5b -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f" returned: 0 in 0.306s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:34 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f is being set with open permissions: ugo+rw Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:34 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f Jul 16 11:13:34 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:34 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:13:34 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:34 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f" returned: 0 in 0.274s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:34 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.264s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:13:34 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.info Jul 16 11:13:34 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Flow 'volume_create_manager' (c769e727-2a05-40d9-a13a-e05089a8c26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746ae413-e124-4190-8ce0-bdb2ac84c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746ae413-e124-4190-8ce0-bdb2ac84c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1225510534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec2a223-504c-4c18-8352-96c16c0490be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09f9765ae6a44889a7ae649fc614fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:13:35Z,use_quota=True,user_id='2e640b34aa744029b87e82611404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda166ca-ba61-4a53-ace5-0d12df9b533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda166ca-ba61-4a53-ace5-0d12df9b533e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec1ae89-c517-42a4-91d6-d90fbae199b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.image.glance [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Creating Keystone auth plugin from conf {{(pid=87345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 11:13:35 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.info" returned: 0 in 0.256s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:35 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.info is being set with open permissions: ugo+rw Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:35 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.info Jul 16 11:13:35 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec1ae89-c517-42a4-91d6-d90fbae199b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ec2a223-504c-4c18-8352-96c16c0490be', 'volume_name': 'volume-7ec2a223-504c-4c18-8352-96c16c0490be', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47999751-ae9e-4a38-bebe-c8bafa49a0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47999751-ae9e-4a38-bebe-c8bafa49a0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401669db-df6b-4c8c-a44f-769e865554c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:35 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Volume 7ec2a223-504c-4c18-8352-96c16c0490be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ec2a223-504c-4c18-8352-96c16c0490be', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Trying to clone 7ec2a223-504c-4c18-8352-96c16c0490be from image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f at location (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]). {{(pid=87345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 11:13:35 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.info" returned: 0 in 0.257s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-bacda4ad-7d7b-4cd4-8976-b7a8e845edd8 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Create snapshot completed successfully Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 11:13:35 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Image download 20.69 MB at 20.69 MB/s Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bda9dd-6dc8-45aa-a48c-e21ceb2c4ded]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:35 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD Jul 16 11:13:35 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:36 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Temporary image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f is fetched for user 2e640b34aa744029b87e82611404727a. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec096d9-dcca-40a4-89fe-1e6a8e0949e7]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:36 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD Jul 16 11:13:36 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:36 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1225510534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec2a223-504c-4c18-8352-96c16c0490be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09f9765ae6a44889a7ae649fc614fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:13:35Z,use_quota=True,user_id='2e640b34aa744029b87e82611404727a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Creating volume 7ec2a223-504c-4c18-8352-96c16c0490be {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:13:36 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:36 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be 1073741824 Jul 16 11:13:36 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Acquiring lock "cinder-ef1cf14d-b297-478b-9ce0-2333e3fbf47f-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "cinder-ef1cf14d-b297-478b-9ce0-2333e3fbf47f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Acquiring lock "cinder-quobyte-cd296078-5d44-4957-aa7a-c9148f056b5b" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "cinder-quobyte-cd296078-5d44-4957-aa7a-c9148f056b5b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Acquiring lock "cinder-quobyte-ef1cf14d-b297-478b-9ce0-2333e3fbf47f" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "cinder-quobyte-ef1cf14d-b297-478b-9ce0-2333e3fbf47f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Deleting offline snapshot ef1cf14d-b297-478b-9ce0-2333e3fbf47f of volume cd296078-5d44-4957-aa7a-c9148f056b5b {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] snapshot_file for this snap is: volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aac11c-d2bb-4493-9008-8f6ec34e0c00]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:36 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f Jul 16 11:13:36 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:36 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be 1073741824" returned: 0 in 0.403s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:36 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be Jul 16 11:13:36 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:37 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f" returned: 0 in 0.373s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd296078-5d44-4957-aa7a-c9148f056b5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c11ed4a-7acd-4d69-8b8b-663146e96fbd]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:37 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be" returned: 0 in 0.243s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Attempting download of 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f ((None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}])) to volume 7ec2a223-504c-4c18-8352-96c16c0490be. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 11:13:37 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b Jul 16 11:13:37 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c5dfa1-55d2-482d-8b89-2229c0e4ed38]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_9b70fj_d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:37 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_9b70fj_d Jul 16 11:13:37 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:37 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b" returned: 0 in 0.361s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:37 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f Jul 16 11:13:37 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:37 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_9b70fj_d" returned: 0 in 0.322s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_9b70fj_d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:37 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_9b70fj_d Jul 16 11:13:37 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:37 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f" returned: 0 in 0.337s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:37 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f Jul 16 11:13:37 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:37 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_9b70fj_d" returned: 1 in 0.332s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_9b70fj_d' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b1266d-c818-47d7-97d5-1f8c860fdd89]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:38 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD Jul 16 11:13:38 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:38 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b.ef1cf14d-b297-478b-9ce0-2333e3fbf47f" returned: 0 in 0.257s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "cinder-quobyte-ef1cf14d-b297-478b-9ce0-2333e3fbf47f" released by "_delete_snapshot" :: held 1.419s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "cinder-quobyte-cd296078-5d44-4957-aa7a-c9148f056b5b" released by "delete_snapshot" :: held 1.439s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Created reservations ['77d99f11-7954-42bc-8a82-fb588851cced', '11830ce4-f631-41b1-8c7f-e4d0802af7bd', 'cc01f0cb-de7f-4e45-8ac6-2d42be666abd', 'e638d2ed-ec77-455c-a449-0f1942f990bf'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:13:38 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Delete snapshot completed successfully. Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f was qcow2, converting to qcow2 {{(pid=87345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838a652-52d3-4176-bd59-0ac8633d0d1b tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "cinder-ef1cf14d-b297-478b-9ce0-2333e3fbf47f-delete_snapshot" released by "delete_snapshot" :: held 1.579s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:38 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be Jul 16 11:13:38 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Acquiring lock "cinder-cd296078-5d44-4957-aa7a-c9148f056b5b-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "cinder-cd296078-5d44-4957-aa7a-c9148f056b5b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Acquiring lock "cinder-quobyte-cd296078-5d44-4957-aa7a-c9148f056b5b" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:13:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "cinder-quobyte-cd296078-5d44-4957-aa7a-c9148f056b5b" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56770ce-c9e9-4c21-8af6-1a051a601024]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:39 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b Jul 16 11:13:39 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:39 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b" returned: 0 in 0.424s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:39 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b Jul 16 11:13:39 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:39 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cd296078-5d44-4957-aa7a-c9148f056b5b" returned: 0 in 0.290s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "cinder-quobyte-cd296078-5d44-4957-aa7a-c9148f056b5b" released by "delete_volume" :: held 0.789s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Created reservations ['a24dbb0e-73f0-4d64-8f71-012c8206a209', '93d3180c-0df4-41b7-a8ac-97c41b02dfb1', '97a7feba-9b68-4f4c-876e-6399d1b7eb3b', '3b6779f0-869b-41d9-882e-92fb95fd655a'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:39 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be" returned: 0 in 1.641s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_385e44b3-f50d-4abd-9c9b-5fd6c16cb66f_uv0dcrt7devstack@QuobyteHD, size 112.00 MB, duration 1.64 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:13:39 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Converted 112.00 MB image at 68.16 MB/s Jul 16 11:13:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:13:39 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:13:39 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:39 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be 1G Jul 16 11:13:39 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:13:40 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.247s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:13:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Deleted volume successfully. Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-a3a5aa79-b41d-45a3-98a7-37abfa117b15 tempest-VolumesSnapshotNegativeTestJSON-1659286065 None] Lock "cinder-cd296078-5d44-4957-aa7a-c9148f056b5b-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:13:40 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be 1G" returned: 0 in 0.352s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Downloaded image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f ((None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}])) to volume 7ec2a223-504c-4c18-8352-96c16c0490be successfully. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Temporary image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f for user 2e640b34aa744029b87e82611404727a is deleted. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Marking volume 7ec2a223-504c-4c18-8352-96c16c0490be as bootable. {{(pid=87345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Copying metadata from image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f to 7ec2a223-504c-4c18-8352-96c16c0490be. {{(pid=87345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Creating volume glance metadata for volume 7ec2a223-504c-4c18-8352-96c16c0490be backed by image 385e44b3-f50d-4abd-9c9b-5fd6c16cb66f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401669db-df6b-4c8c-a44f-769e865554c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec2a223-504c-4c18-8352-96c16c0490be', 'volume_size': 1, 'image_id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '639d17b0d1c84ef58e617a9ee2432960', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '385e44b3-f50d-4abd-9c9b-5fd6c16cb66f', 'created_at': datetime.datetime(2026, 7, 16, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/385e44b3-f50d-4abd-9c9b-5fd6c16cb66f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60203a14-5c4f-49da-b6f3-9f1a6376e378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:13:40 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Volume volume-7ec2a223-504c-4c18-8352-96c16c0490be (7ec2a223-504c-4c18-8352-96c16c0490be): created successfully Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60203a14-5c4f-49da-b6f3-9f1a6376e378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:13:40 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Flow 'volume_create_manager' (c769e727-2a05-40d9-a13a-e05089a8c26e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:13:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b30248ac-47f2-490c-bfbc-f3ca36593397 tempest-TestShelveInstance-1078645408 None] Created volume successfully. Jul 16 11:13:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-8947f147-98b0-46e7-a497-e35d3d66fdb6 req-5ad52ff0-5940-457b-8895-b6df89b4cba5 tempest-TestShelveInstance-1078645408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:13:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-8947f147-98b0-46e7-a497-e35d3d66fdb6 req-5ad52ff0-5940-457b-8895-b6df89b4cba5 tempest-TestShelveInstance-1078645408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:13:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-8947f147-98b0-46e7-a497-e35d3d66fdb6 req-5ad52ff0-5940-457b-8895-b6df89b4cba5 tempest-TestShelveInstance-1078645408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:13:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-8947f147-98b0-46e7-a497-e35d3d66fdb6 req-5ad52ff0-5940-457b-8895-b6df89b4cba5 tempest-TestShelveInstance-1078645408 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-7ec2a223-504c-4c18-8352-96c16c0490be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed8e2fe1-f19b-404f-b0aa-fb6bf7675737', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:13:43 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-8947f147-98b0-46e7-a497-e35d3d66fdb6 req-5ad52ff0-5940-457b-8895-b6df89b4cba5 tempest-TestShelveInstance-1078645408 None] attachment_update completed successfully. Jul 16 11:13:53 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=34,cinder:UPDATE=21,cinder:DELETE=2,cinder:INSERT=10 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:13:53 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=49,cinder:UPDATE=45,cinder:DELETE=5,cinder:INSERT=19 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:14:18 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-073014db-8ddc-47bb-a2be-50b9fadf1549 req-b524f1d8-9c7c-41ce-8839-50b91a42168d tempest-TestShelveInstance-1078645408 None] Terminate volume connection completed successfully. Jul 16 11:14:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-073014db-8ddc-47bb-a2be-50b9fadf1549 req-b524f1d8-9c7c-41ce-8839-50b91a42168d tempest-TestShelveInstance-1078645408 None] Deleting attachment ed8e2fe1-f19b-404f-b0aa-fb6bf7675737. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:14:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-224d89eb-d0dc-4708-8870-2870713f6693 req-9b4f291a-d541-4422-a13d-454524d5d5f7 tempest-TestShelveInstance-1078645408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:14:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-224d89eb-d0dc-4708-8870-2870713f6693 req-9b4f291a-d541-4422-a13d-454524d5d5f7 tempest-TestShelveInstance-1078645408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:14:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-224d89eb-d0dc-4708-8870-2870713f6693 req-9b4f291a-d541-4422-a13d-454524d5d5f7 tempest-TestShelveInstance-1078645408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:14:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-224d89eb-d0dc-4708-8870-2870713f6693 req-9b4f291a-d541-4422-a13d-454524d5d5f7 tempest-TestShelveInstance-1078645408 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-7ec2a223-504c-4c18-8352-96c16c0490be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2b02b22-3531-4f8b-8a7a-4712aadbcc5b', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:14:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-224d89eb-d0dc-4708-8870-2870713f6693 req-9b4f291a-d541-4422-a13d-454524d5d5f7 tempest-TestShelveInstance-1078645408 None] attachment_update completed successfully. Jul 16 11:14:30 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:14:30 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:14:34 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:14:34 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:14:34 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.277s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:14:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Flow 'volume_create_manager' (8cd73407-0457-4f36-9986-7ca968bee8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73612a47-2705-4a71-878a-7eb667237a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73612a47-2705-4a71-878a-7eb667237a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1936639897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2677e9-633c-4d2e-afdd-f424fd669945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64e2285f669a4f31bdad0e25bb815db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:14:36Z,use_quota=True,user_id='1c625dae4e0e40bfa9145ba25fd6c4b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0a1a5c-911f-4f13-a578-e025b8b1730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0a1a5c-911f-4f13-a578-e025b8b1730b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc0bd5c-5594-460c-85de-e050d578f313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc0bd5c-5594-460c-85de-e050d578f313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2677e9-633c-4d2e-afdd-f424fd669945', 'volume_name': 'volume-8a2677e9-633c-4d2e-afdd-f424fd669945', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14d7cf1-4b2e-44eb-b789-419c26e651b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14d7cf1-4b2e-44eb-b789-419c26e651b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47f49e9-1421-4e06-81ed-599931a2e6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:14:35 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Volume 8a2677e9-633c-4d2e-afdd-f424fd669945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2677e9-633c-4d2e-afdd-f424fd669945', 'volume_size': 1} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1936639897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2677e9-633c-4d2e-afdd-f424fd669945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64e2285f669a4f31bdad0e25bb815db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:14:36Z,use_quota=True,user_id='1c625dae4e0e40bfa9145ba25fd6c4b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Creating volume 8a2677e9-633c-4d2e-afdd-f424fd669945 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:14:35 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:14:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:14:35 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945 1073741824 Jul 16 11:14:35 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:14:36 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Jul 16 11:14:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945 1073741824" returned: 0 in 0.437s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:14:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:14:36 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945 Jul 16 11:14:36 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:14:36 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 16 11:14:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945" returned: 0 in 0.254s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:14:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:14:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:14:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47f49e9-1421-4e06-81ed-599931a2e6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2677e9-633c-4d2e-afdd-f424fd669945', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:14:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665df526-86b8-4210-8a9e-bc558269a8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:14:36 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Volume volume-8a2677e9-633c-4d2e-afdd-f424fd669945 (8a2677e9-633c-4d2e-afdd-f424fd669945): created successfully Jul 16 11:14:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665df526-86b8-4210-8a9e-bc558269a8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:14:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Flow 'volume_create_manager' (8cd73407-0457-4f36-9986-7ca968bee8e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:14:36 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-975e859e-15ec-47d8-bfb4-32a25c70680a tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Created volume successfully. Jul 16 11:14:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-da5d8e90-d113-4f6f-bcd0-eb451398d95d req-1b0b5846-ad78-473c-b7ff-08efd717611d tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:14:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-da5d8e90-d113-4f6f-bcd0-eb451398d95d req-1b0b5846-ad78-473c-b7ff-08efd717611d tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:14:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-da5d8e90-d113-4f6f-bcd0-eb451398d95d req-1b0b5846-ad78-473c-b7ff-08efd717611d tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:14:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-da5d8e90-d113-4f6f-bcd0-eb451398d95d req-1b0b5846-ad78-473c-b7ff-08efd717611d tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-8a2677e9-633c-4d2e-afdd-f424fd669945', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb1b95d8-478b-4a9a-9e2e-9ae59fad85d5', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:14:37 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-da5d8e90-d113-4f6f-bcd0-eb451398d95d req-1b0b5846-ad78-473c-b7ff-08efd717611d tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] attachment_update completed successfully. Jul 16 11:14:39 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-672a751e-5b4c-4878-b9c4-d5388dab3ea9 req-ce11922c-d7f1-4228-974c-44cc8c2bc501 tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Terminate volume connection completed successfully. Jul 16 11:14:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-672a751e-5b4c-4878-b9c4-d5388dab3ea9 req-ce11922c-d7f1-4228-974c-44cc8c2bc501 tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Deleting attachment cb1b95d8-478b-4a9a-9e2e-9ae59fad85d5. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:14:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Acquiring lock "cinder-8a2677e9-633c-4d2e-afdd-f424fd669945-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:14:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "cinder-8a2677e9-633c-4d2e-afdd-f424fd669945-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:14:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Acquiring lock "cinder-quobyte-8a2677e9-633c-4d2e-afdd-f424fd669945" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:14:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "cinder-quobyte-8a2677e9-633c-4d2e-afdd-f424fd669945" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:14:40 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c8dda3-730b-43fe-8c2d-866471286541]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:14:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:14:40 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945 Jul 16 11:14:40 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:14:41 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945" returned: 0 in 0.355s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:14:41 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945 Jul 16 11:14:41 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:14:41 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8a2677e9-633c-4d2e-afdd-f424fd669945" returned: 0 in 0.240s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "cinder-quobyte-8a2677e9-633c-4d2e-afdd-f424fd669945" released by "delete_volume" :: held 0.630s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Created reservations ['fb48d967-4476-4ee0-9b7c-eff631a7e90a', 'dc3ba2a3-408c-4dee-ac82-543f2226130c', '250105d9-1d8f-4787-8b4b-517c90dd8815', 'ab945320-e21a-40c8-9eed-eab223212332'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:14:41 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:14:41 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:14:41 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:14:41 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Deleted volume successfully. Jul 16 11:14:41 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-74c43f30-0426-42f2-b287-926eb581307e tempest-TestServerVolumeAttachScenarioOldVersion-1410786253 None] Lock "cinder-8a2677e9-633c-4d2e-afdd-f424fd669945-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:14:48 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-fb6b8f27-5686-470f-8ebf-1286c2ac5e1f tempest-TestShelveInstance-1078645408 None] Terminate volume connection completed successfully. Jul 16 11:14:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-fb6b8f27-5686-470f-8ebf-1286c2ac5e1f tempest-TestShelveInstance-1078645408 None] Deleting attachment b2b02b22-3531-4f8b-8a7a-4712aadbcc5b. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:14:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Acquiring lock "cinder-7ec2a223-504c-4c18-8352-96c16c0490be-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:14:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Lock "cinder-7ec2a223-504c-4c18-8352-96c16c0490be-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:14:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Acquiring lock "cinder-quobyte-7ec2a223-504c-4c18-8352-96c16c0490be" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:14:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Lock "cinder-quobyte-7ec2a223-504c-4c18-8352-96c16c0490be" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:14:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b7bcf8-2507-4572-93a2-6a8b1c9979fc]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:14:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:14:49 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be Jul 16 11:14:49 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:14:49 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jul 16 11:14:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be" returned: 0 in 0.494s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:14:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:14:49 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be Jul 16 11:14:49 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:14:50 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ec2a223-504c-4c18-8352-96c16c0490be" returned: 0 in 0.264s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Lock "cinder-quobyte-7ec2a223-504c-4c18-8352-96c16c0490be" released by "delete_volume" :: held 0.821s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG cinder.quota [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Created reservations ['38d31f3a-0857-473f-bd43-bd3969611dd8', '8108a381-be02-4a35-8815-4f8d2c07649e', 'f4c8715b-5451-44f2-9571-5ffda0ce59f4', '44810317-9c0e-4931-b1b2-eedf72edc80f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:14:50 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:14:50 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:14:50 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.333s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG cinder.manager [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:14:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Deleted volume successfully. Jul 16 11:14:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [req-d833e66d-234a-4a3b-944b-c7f4dd911629 req-eda56074-44b2-4c09-9050-7973205ceb5d tempest-TestShelveInstance-1078645408 None] Lock "cinder-7ec2a223-504c-4c18-8352-96c16c0490be-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:00 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=19,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:15:00 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=22,cinder:SELECT=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (57186bac-221e-4b1d-ae22-a761ee68158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c76707-51a7-4f1a-96e1-610baec9c8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c76707-51a7-4f1a-96e1-610baec9c8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744258286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e47b8bc-3af7-4d2a-873d-7020928f4dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:01Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac81379b-ca6e-4c9e-a976-f669e40d35ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac81379b-ca6e-4c9e-a976-f669e40d35ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8754d551-11cd-4f0a-92a3-3ee38bb08f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8754d551-11cd-4f0a-92a3-3ee38bb08f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e47b8bc-3af7-4d2a-873d-7020928f4dfe', 'volume_name': 'volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02c63b6-1dc2-4d4d-bc6c-83e14f7ea7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e02c63b6-1dc2-4d4d-bc6c-83e14f7ea7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c42bb89-0a22-43d4-8b10-f45ab4d0fdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:01 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume 9e47b8bc-3af7-4d2a-873d-7020928f4dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe', 'volume_size': 1} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744258286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e47b8bc-3af7-4d2a-873d-7020928f4dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:01Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Creating volume 9e47b8bc-3af7-4d2a-873d-7020928f4dfe {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:01 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:01 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe 1073741824 Jul 16 11:15:01 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:02 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe 1073741824" returned: 0 in 0.459s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:02 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe Jul 16 11:15:02 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:02 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe" returned: 0 in 0.319s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c42bb89-0a22-43d4-8b10-f45ab4d0fdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba2311a-0212-4024-b39c-9e0cb6507861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:02 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe (9e47b8bc-3af7-4d2a-873d-7020928f4dfe): created successfully Jul 16 11:15:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba2311a-0212-4024-b39c-9e0cb6507861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (57186bac-221e-4b1d-ae22-a761ee68158b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:02 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c42baaa1-b2c9-4f00-9132-b41e7df34dee tempest-CreateVolumesFromSnapshotTest-428447230 None] Created volume successfully. Jul 16 11:15:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] Creating offline snapshot 19f1fe79-c347-49a2-8086-b0ca3da51686 of volume 9e47b8bc-3af7-4d2a-873d-7020928f4dfe {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:15:03 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f75d38a-63a1-4782-a1d4-480465eed196]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:03 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe Jul 16 11:15:03 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:04 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe" returned: 0 in 0.451s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:04 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 1G Jul 16 11:15:04 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:04 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 1G" returned: 0 in 0.442s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:04 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 Jul 16 11:15:04 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:05 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686" returned: 0 in 0.292s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:05 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 is being set with open permissions: ugo+rw Jul 16 11:15:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:05 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 Jul 16 11:15:05 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:05 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:05 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.info Jul 16 11:15:05 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:05 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.info" returned: 0 in 0.279s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:05 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.info is being set with open permissions: ugo+rw Jul 16 11:15:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:05 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.info Jul 16 11:15:05 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:05 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.info" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:05 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-37e25b37-c3bd-4d95-bba1-aae4e334aae5 tempest-CreateVolumesFromSnapshotTest-428447230 None] Create snapshot completed successfully Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (2c9dea35-07ab-46a5-adfd-13d7d3119b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ddfe73-4a02-4580-a858-f1df0f7d5419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ddfe73-4a02-4580-a858-f1df0f7d5419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088610868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fa1066-8d0c-42f0-98ee-5a20557b0c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:07Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef2872d-18e2-4882-b2de-45654900c903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef2872d-18e2-4882-b2de-45654900c903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3fd349-f848-4766-834a-95d6cb1c998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3fd349-f848-4766-834a-95d6cb1c998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69fa1066-8d0c-42f0-98ee-5a20557b0c7b', 'volume_name': 'volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1165f20f-f2ee-4802-a496-f3ad2d9f2798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1165f20f-f2ee-4802-a496-f3ad2d9f2798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d312fa4-0163-47f7-b3c3-625aeebb9c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume 69fa1066-8d0c-42f0-98ee-5a20557b0c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b', 'volume_size': 1} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2088610868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fa1066-8d0c-42f0-98ee-5a20557b0c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:07Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Creating volume 69fa1066-8d0c-42f0-98ee-5a20557b0c7b {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:07 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:07 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b 1073741824 Jul 16 11:15:07 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (4a1b357e-c53e-4a50-af4f-77849da9b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b038b0-877b-4ebf-b7f5-bb89612a7a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b038b0-877b-4ebf-b7f5-bb89612a7a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-970979869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544d67be-7518-448f-93aa-d82fff97765b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:08Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94f016a-bd29-4e2c-857c-c8d1ada8b8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94f016a-bd29-4e2c-857c-c8d1ada8b8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af183115-a2cf-4f72-868e-4796c9fb5555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af183115-a2cf-4f72-868e-4796c9fb5555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544d67be-7518-448f-93aa-d82fff97765b', 'volume_name': 'volume-544d67be-7518-448f-93aa-d82fff97765b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b44a9f-1538-450d-adb6-607ea7e3e49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b44a9f-1538-450d-adb6-607ea7e3e49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c0698e-3592-4d46-82d1-d4f7a703e90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume 544d67be-7518-448f-93aa-d82fff97765b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544d67be-7518-448f-93aa-d82fff97765b', 'volume_size': 1} Jul 16 11:15:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:08 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b 1073741824" returned: 0 in 0.534s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:08 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b Jul 16 11:15:08 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (768d747b-95ca-44c3-8697-ec0bb40ed3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a21313-01a5-4082-9aea-23a9db05dc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a21313-01a5-4082-9aea-23a9db05dc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-81179162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb8faeca-ed36-4506-a482-f91f6f75aa17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:08Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d8baff-af60-447f-bacc-8117321af6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d8baff-af60-447f-bacc-8117321af6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae80ceb-04f9-499e-92a1-bf7388f2bb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae80ceb-04f9-499e-92a1-bf7388f2bb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb8faeca-ed36-4506-a482-f91f6f75aa17', 'volume_name': 'volume-bb8faeca-ed36-4506-a482-f91f6f75aa17', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6dfd7d3-d9f1-4a25-8fc1-da144fa4473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6dfd7d3-d9f1-4a25-8fc1-da144fa4473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b31df9-1921-4572-b820-cc6718482ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume bb8faeca-ed36-4506-a482-f91f6f75aa17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb8faeca-ed36-4506-a482-f91f6f75aa17', 'volume_size': 1} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:08 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b" returned: 0 in 0.346s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.541s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-970979869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544d67be-7518-448f-93aa-d82fff97765b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:08Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Creating volume 544d67be-7518-448f-93aa-d82fff97765b {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:08 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d312fa4-0163-47f7-b3c3-625aeebb9c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:08 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b 1073741824 Jul 16 11:15:08 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6f296e-b3aa-4003-b10a-dac7579ca15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b (69fa1066-8d0c-42f0-98ee-5a20557b0c7b): created successfully Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6f296e-b3aa-4003-b10a-dac7579ca15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (2c9dea35-07ab-46a5-adfd-13d7d3119b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:08 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-1e03b74c-0f17-4219-a8ad-1fc12de58623 tempest-CreateVolumesFromSnapshotTest-428447230 None] Created volume successfully. Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (f3bce0cc-4839-45f8-9c81-0343e47058d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc53eef-6f9c-409e-900c-e6fa150fea57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc53eef-6f9c-409e-900c-e6fa150fea57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721127222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb47641-a350-43fc-a142-352cbb21fbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:09Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad0cf32-da4c-4c7c-80b1-f184cb1b0e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad0cf32-da4c-4c7c-80b1-f184cb1b0e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69474b3d-ddc8-433e-b0a1-ba041485a752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69474b3d-ddc8-433e-b0a1-ba041485a752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb47641-a350-43fc-a142-352cbb21fbc4', 'volume_name': 'volume-eeb47641-a350-43fc-a142-352cbb21fbc4', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e98625-8de5-4720-8cd5-869db16ac684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e98625-8de5-4720-8cd5-869db16ac684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7e5c04-cf96-42da-becc-e55547f180aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume eeb47641-a350-43fc-a142-352cbb21fbc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb47641-a350-43fc-a142-352cbb21fbc4', 'volume_size': 1} Jul 16 11:15:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:09 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b 1073741824" returned: 0 in 0.581s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:09 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b Jul 16 11:15:09 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (3949cf32-0d6f-4031-85c3-06d638e61bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3730237d-c84b-4868-9ea1-1d2390a57401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3730237d-c84b-4868-9ea1-1d2390a57401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318364134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690a6a23-ba3d-40a7-8cfb-7030573bc674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:09Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2f6004-9a91-4dd0-bf00-4cd77ee37cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2f6004-9a91-4dd0-bf00-4cd77ee37cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0d4eb5-1235-412e-8c27-4516d5cbdda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0d4eb5-1235-412e-8c27-4516d5cbdda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '690a6a23-ba3d-40a7-8cfb-7030573bc674', 'volume_name': 'volume-690a6a23-ba3d-40a7-8cfb-7030573bc674', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8a8d3f-1ac3-4f09-adeb-42f7f3f623da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8a8d3f-1ac3-4f09-adeb-42f7f3f623da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a21a1a2-c1bf-4555-9f01-cf73c0a8c9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume 690a6a23-ba3d-40a7-8cfb-7030573bc674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-690a6a23-ba3d-40a7-8cfb-7030573bc674', 'volume_size': 1} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:09 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.982s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-81179162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb8faeca-ed36-4506-a482-f91f6f75aa17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:08Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Creating volume bb8faeca-ed36-4506-a482-f91f6f75aa17 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:09 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c0698e-3592-4d46-82d1-d4f7a703e90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544d67be-7518-448f-93aa-d82fff97765b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634605de-9d29-46c0-a78d-b89381456fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:09 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17 1073741824 Jul 16 11:15:09 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume volume-544d67be-7518-448f-93aa-d82fff97765b (544d67be-7518-448f-93aa-d82fff97765b): created successfully Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634605de-9d29-46c0-a78d-b89381456fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (4a1b357e-c53e-4a50-af4f-77849da9b282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-dd90c231-69b8-4bd4-a9aa-8906e018ea40 tempest-CreateVolumesFromSnapshotTest-428447230 None] Created volume successfully. Jul 16 11:15:09 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17 1073741824" returned: 0 in 0.418s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:09 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17 Jul 16 11:15:09 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:10 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17" returned: 0 in 0.348s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.301s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-721127222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb47641-a350-43fc-a142-352cbb21fbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:09Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Creating volume eeb47641-a350-43fc-a142-352cbb21fbc4 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:10 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b31df9-1921-4572-b820-cc6718482ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb8faeca-ed36-4506-a482-f91f6f75aa17', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a18bd2-525f-45eb-a374-d26905e0b1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:10 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4 1073741824 Jul 16 11:15:10 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:10 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume volume-bb8faeca-ed36-4506-a482-f91f6f75aa17 (bb8faeca-ed36-4506-a482-f91f6f75aa17): created successfully Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a18bd2-525f-45eb-a374-d26905e0b1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (768d747b-95ca-44c3-8697-ec0bb40ed3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:10 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-85e25d76-6a0b-463f-ab89-38b1f1533f0d tempest-CreateVolumesFromSnapshotTest-428447230 None] Created volume successfully. Jul 16 11:15:10 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4 1073741824" returned: 0 in 0.462s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:10 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4 Jul 16 11:15:10 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:10 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4" returned: 0 in 0.245s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318364134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690a6a23-ba3d-40a7-8cfb-7030573bc674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f31c6e9f9849a1b93940ab92225f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:09Z,use_quota=True,user_id='46d75413f127431eb34ecb0da4505fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Creating volume 690a6a23-ba3d-40a7-8cfb-7030573bc674 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:10 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7e5c04-cf96-42da-becc-e55547f180aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb47641-a350-43fc-a142-352cbb21fbc4', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:10 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674 1073741824 Jul 16 11:15:10 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0ce676-caef-4ffc-a87f-28a5f213e4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:10 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume volume-eeb47641-a350-43fc-a142-352cbb21fbc4 (eeb47641-a350-43fc-a142-352cbb21fbc4): created successfully Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0ce676-caef-4ffc-a87f-28a5f213e4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (f3bce0cc-4839-45f8-9c81-0343e47058d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:10 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-81063219-23e0-40ba-9a50-c888b74a28a7 tempest-CreateVolumesFromSnapshotTest-428447230 None] Created volume successfully. Jul 16 11:15:11 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674 1073741824" returned: 0 in 0.497s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:11 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674 Jul 16 11:15:11 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:11 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674" returned: 0 in 0.247s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a21a1a2-c1bf-4555-9f01-cf73c0a8c9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-690a6a23-ba3d-40a7-8cfb-7030573bc674', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff52deb9-6610-4ca3-a256-c41166263e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:11 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Volume volume-690a6a23-ba3d-40a7-8cfb-7030573bc674 (690a6a23-ba3d-40a7-8cfb-7030573bc674): created successfully Jul 16 11:15:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff52deb9-6610-4ca3-a256-c41166263e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Flow 'volume_create_manager' (3949cf32-0d6f-4031-85c3-06d638e61bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:11 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4facdcc2-5e5f-4313-a65f-f787d9886eaf tempest-CreateVolumesFromSnapshotTest-428447230 None] Created volume successfully. Jul 16 11:15:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-690a6a23-ba3d-40a7-8cfb-7030573bc674-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-690a6a23-ba3d-40a7-8cfb-7030573bc674-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-quobyte-690a6a23-ba3d-40a7-8cfb-7030573bc674" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-690a6a23-ba3d-40a7-8cfb-7030573bc674" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:12 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7914a88e-a588-4ceb-9f23-2b73a758d9cb]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:12 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674 Jul 16 11:15:12 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:12 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674" returned: 0 in 0.368s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:12 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674 Jul 16 11:15:12 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:13 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-690a6a23-ba3d-40a7-8cfb-7030573bc674" returned: 0 in 0.266s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-690a6a23-ba3d-40a7-8cfb-7030573bc674" released by "delete_volume" :: held 0.682s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Created reservations ['bf6434d9-84aa-4850-8832-3133dc78f800', 'b82d36d3-2724-4a6c-9395-1a31b4ae1fb3', '87cbbfaf-452d-4ab5-9a2d-c8a816c00763', '078b29f3-e4c9-4bea-b35b-759d69756992'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:13 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:13 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:13 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.253s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:13 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Deleted volume successfully. Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-49bed221-8dab-4900-9427-80e9e23fb5ed tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-690a6a23-ba3d-40a7-8cfb-7030573bc674-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-eeb47641-a350-43fc-a142-352cbb21fbc4-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-eeb47641-a350-43fc-a142-352cbb21fbc4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-quobyte-eeb47641-a350-43fc-a142-352cbb21fbc4" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-eeb47641-a350-43fc-a142-352cbb21fbc4" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8293ca-1a51-4e39-b721-09acf32eb6bc]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:13 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4 Jul 16 11:15:13 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:14 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4" returned: 0 in 0.424s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:14 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4 Jul 16 11:15:14 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:14 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eeb47641-a350-43fc-a142-352cbb21fbc4" returned: 0 in 0.285s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-eeb47641-a350-43fc-a142-352cbb21fbc4" released by "delete_volume" :: held 0.759s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Created reservations ['08febba3-5e1f-44cf-b69b-7f07401ad29f', '2f41ed67-7b6b-42ad-bb22-e99b73c3b22c', '9c5172dd-1444-466b-ac4b-2d3cac39b5e5', 'c7882452-da27-400a-980c-b70d7740c249'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:14 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:14 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-bb8faeca-ed36-4506-a482-f91f6f75aa17-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-bb8faeca-ed36-4506-a482-f91f6f75aa17-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-quobyte-bb8faeca-ed36-4506-a482-f91f6f75aa17" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-bb8faeca-ed36-4506-a482-f91f6f75aa17" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:14 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.356s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3037310-206f-4079-b187-efcacfbff1b8]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Deleted volume successfully. Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6838361a-41bf-4649-b4dc-fb23f0a729f3 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-eeb47641-a350-43fc-a142-352cbb21fbc4-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:15 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17 Jul 16 11:15:15 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:15 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17" returned: 0 in 0.360s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:15 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17 Jul 16 11:15:15 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:15 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb8faeca-ed36-4506-a482-f91f6f75aa17" returned: 0 in 0.267s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-bb8faeca-ed36-4506-a482-f91f6f75aa17" released by "delete_volume" :: held 0.680s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Created reservations ['7d5d4f77-fa81-4c84-9f40-69c912e4d146', '30f54e79-d53a-4a7d-abd2-de23323a6298', 'acc20e11-f8e4-42cf-8bf4-71f86540611c', '7ab05982-c34c-4a25-9ab3-e5f1a99e5e17'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Flow 'volume_create_manager' (de33260c-18c7-4547-8416-2723c4ea34ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2550aa-17bb-40ff-87a2-2c9ed12d21b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2550aa-17bb-40ff-87a2-2c9ed12d21b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1579239280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd7548f-c6aa-4171-883b-ad71da3da4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbef40eb15945429f617bf169e2f1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:16Z,use_quota=True,user_id='63a8f827c86a42cda0b749eb61675b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d97b19d-aede-4fb7-b4ad-f8084f4ccf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d97b19d-aede-4fb7-b4ad-f8084f4ccf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:15 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:15 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7870c8fb-8f77-4f7e-90f6-6cf982d09065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7870c8fb-8f77-4f7e-90f6-6cf982d09065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd7548f-c6aa-4171-883b-ad71da3da4bf', 'volume_name': 'volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1eb5f5d-1ab3-4ab6-97c3-5c6e3267e839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1eb5f5d-1ab3-4ab6-97c3-5c6e3267e839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394f0012-456e-4bc5-9c76-53365d7b656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:15 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Volume 4cd7548f-c6aa-4171-883b-ad71da3da4bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf', 'volume_size': 1} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1579239280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd7548f-c6aa-4171-883b-ad71da3da4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbef40eb15945429f617bf169e2f1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:16Z,use_quota=True,user_id='63a8f827c86a42cda0b749eb61675b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Creating volume 4cd7548f-c6aa-4171-883b-ad71da3da4bf {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:15 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:15 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf 1073741824 Jul 16 11:15:15 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:16 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.282s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:16 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Deleted volume successfully. Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Flow 'volume_create_manager' (07ddac00-404e-4126-8443-ef425f9643c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af20ab4-aa9e-428f-995b-3b6e3370f21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-544d67be-7518-448f-93aa-d82fff97765b-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af20ab4-aa9e-428f-995b-3b6e3370f21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-786299466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1daa2a78-4e48-44cb-83f6-a9447dfbf9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbef40eb15945429f617bf169e2f1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:16Z,use_quota=True,user_id='63a8f827c86a42cda0b749eb61675b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fedd074e-95ad-4ba9-adb2-2734cd844a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fedd074e-95ad-4ba9-adb2-2734cd844a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b863c5be-ce69-4857-bc69-0aece99b6357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b863c5be-ce69-4857-bc69-0aece99b6357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1daa2a78-4e48-44cb-83f6-a9447dfbf9d4', 'volume_name': 'volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3655acf-d0e4-44eb-ba6b-15d348ea1bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3655acf-d0e4-44eb-ba6b-15d348ea1bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03565e32-acd8-4a3f-b9a5-8bf721822e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:16 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Volume 1daa2a78-4e48-44cb-83f6-a9447dfbf9d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4', 'volume_size': 1} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f4008b59-629e-48b2-9210-c0b20845a775 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-bb8faeca-ed36-4506-a482-f91f6f75aa17-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-544d67be-7518-448f-93aa-d82fff97765b-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-quobyte-544d67be-7518-448f-93aa-d82fff97765b" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-544d67be-7518-448f-93aa-d82fff97765b" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e45bef-b4ba-43d9-97bb-a6c32a306a01]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:16 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf 1073741824" returned: 0 in 0.560s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:16 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b Jul 16 11:15:16 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:16 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf Jul 16 11:15:16 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:16 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b" returned: 0 in 0.391s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:16 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b Jul 16 11:15:16 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:16 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf" returned: 0 in 0.280s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-786299466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1daa2a78-4e48-44cb-83f6-a9447dfbf9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bbef40eb15945429f617bf169e2f1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:16Z,use_quota=True,user_id='63a8f827c86a42cda0b749eb61675b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Creating volume 1daa2a78-4e48-44cb-83f6-a9447dfbf9d4 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:16 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394f0012-456e-4bc5-9c76-53365d7b656c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:16 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4 1073741824 Jul 16 11:15:16 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94dbf886-2299-466e-b36a-c3d506ddccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:16 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Volume volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf (4cd7548f-c6aa-4171-883b-ad71da3da4bf): created successfully Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94dbf886-2299-466e-b36a-c3d506ddccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Flow 'volume_create_manager' (de33260c-18c7-4547-8416-2723c4ea34ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:16 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-356541d2-abfa-4bca-9f55-00a7924255b1 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Created volume successfully. Jul 16 11:15:17 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-544d67be-7518-448f-93aa-d82fff97765b" returned: 0 in 0.266s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-544d67be-7518-448f-93aa-d82fff97765b" released by "delete_volume" :: held 0.713s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Created reservations ['e3f7ec84-8f7f-4a30-9358-2211b0cdfdb1', 'af609a01-2ee6-48be-a2ea-43d02d7f6393', '7ca7281d-d584-4a6e-928f-878d98e7e67d', '20ab664c-e24c-424d-ae88-8e295a5b5531'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:17 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:17 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:17 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-69fa1066-8d0c-42f0-98ee-5a20557b0c7b-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4 1073741824" returned: 0 in 0.559s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-69fa1066-8d0c-42f0-98ee-5a20557b0c7b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-quobyte-69fa1066-8d0c-42f0-98ee-5a20557b0c7b" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:17 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4 Jul 16 11:15:17 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-69fa1066-8d0c-42f0-98ee-5a20557b0c7b" acquired by "delete_volume" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccf585b-ca9d-4878-98db-4318daf604d8]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:17 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.361s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Deleted volume successfully. Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-19edbebf-bdbd-48ee-aca1-48730e9d42e0 tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-544d67be-7518-448f-93aa-d82fff97765b-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:17 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b Jul 16 11:15:17 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:17 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4" returned: 0 in 0.313s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03565e32-acd8-4a3f-b9a5-8bf721822e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c23f43-2aac-4402-a845-16b9595e1ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:17 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Volume volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4 (1daa2a78-4e48-44cb-83f6-a9447dfbf9d4): created successfully Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c23f43-2aac-4402-a845-16b9595e1ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Flow 'volume_create_manager' (07ddac00-404e-4126-8443-ef425f9643c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9fd0d18b-acd2-4d84-b674-99ad53e99149 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Created volume successfully. Jul 16 11:15:17 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b" returned: 0 in 0.414s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:17 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b Jul 16 11:15:17 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:18 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-69fa1066-8d0c-42f0-98ee-5a20557b0c7b" returned: 0 in 0.251s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-69fa1066-8d0c-42f0-98ee-5a20557b0c7b" released by "delete_volume" :: held 0.716s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Created reservations ['8bc2f37b-9ffb-4789-8f6d-d58ba328765d', '05f78908-9aff-4314-bbba-1d6097debf23', '3c71dcbb-6a73-4676-8976-9d90d54aadea', 'c6793a1b-9b58-477d-bca3-190840e6cb17'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:18 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:18 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-19f1fe79-c347-49a2-8086-b0ca3da51686-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:18 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.277s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-19f1fe79-c347-49a2-8086-b0ca3da51686-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-quobyte-9e47b8bc-3af7-4d2a-873d-7020928f4dfe" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:18 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Deleted volume successfully. Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-9e47b8bc-3af7-4d2a-873d-7020928f4dfe" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-quobyte-19f1fe79-c347-49a2-8086-b0ca3da51686" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0b86c06e-3031-47d2-a1c2-78902afe3cfd tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-69fa1066-8d0c-42f0-98ee-5a20557b0c7b-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-19f1fe79-c347-49a2-8086-b0ca3da51686" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Deleting offline snapshot 19f1fe79-c347-49a2-8086-b0ca3da51686 of volume 9e47b8bc-3af7-4d2a-873d-7020928f4dfe {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] snapshot_file for this snap is: volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd654f3-a620-4541-b898-883c73fb113f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:18 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 Jul 16 11:15:18 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:19 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686" returned: 0 in 0.376s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:15:19 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b437e0b-df9d-438c-99c1-7d22df69aa98]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:19 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe Jul 16 11:15:19 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:19 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe" returned: 0 in 0.368s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:19 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 Jul 16 11:15:19 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:19 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686" returned: 0 in 0.376s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:19 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686 Jul 16 11:15:19 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:20 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe.19f1fe79-c347-49a2-8086-b0ca3da51686" returned: 0 in 0.274s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-19f1fe79-c347-49a2-8086-b0ca3da51686" released by "_delete_snapshot" :: held 1.518s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-9e47b8bc-3af7-4d2a-873d-7020928f4dfe" released by "delete_snapshot" :: held 1.544s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:20 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Created reservations ['1b6edc81-927e-46cf-9a2e-a52207952b73', 'd8a6aac7-c471-461f-a6a2-1cb197b8991f', 'f266ea3d-dd0e-46f1-ab29-2fffd7b383cf', 'b9f2b389-77cf-4c9b-aa4b-3591670bf1f9'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Delete snapshot completed successfully. Jul 16 11:15:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-48b24c6f-6e3c-40e0-bdae-9310ec6ed1aa tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-19f1fe79-c347-49a2-8086-b0ca3da51686-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-9e47b8bc-3af7-4d2a-873d-7020928f4dfe-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-9e47b8bc-3af7-4d2a-873d-7020928f4dfe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "cinder-quobyte-9e47b8bc-3af7-4d2a-873d-7020928f4dfe" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-9e47b8bc-3af7-4d2a-873d-7020928f4dfe" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f62fd0-8497-4b10-a7bd-4dd1886c506b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:21 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe Jul 16 11:15:21 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:21 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe" returned: 0 in 0.378s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:21 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe Jul 16 11:15:21 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:21 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e47b8bc-3af7-4d2a-873d-7020928f4dfe" returned: 0 in 0.267s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-quobyte-9e47b8bc-3af7-4d2a-873d-7020928f4dfe" released by "delete_volume" :: held 0.725s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Created reservations ['d9c98bde-d0b8-4b20-ad40-a8ea94bbb517', '6d884234-a296-48d3-9ac4-366f07de01f4', '3dd76308-c695-4acf-83d8-99d68de533ee', '4523f53a-8542-4890-ac05-05ecbf878895'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:21 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:21 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:21 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:21 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Deleted volume successfully. Jul 16 11:15:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47b06520-4099-4373-9379-0fa9e006a54f tempest-CreateVolumesFromSnapshotTest-428447230 None] Lock "cinder-9e47b8bc-3af7-4d2a-873d-7020928f4dfe-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Flow 'volume_create_manager' (66eed163-b0bf-4b96-99e4-1b7361f2b528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5472b6dc-1255-4a4d-9ec9-35ec7d871900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5472b6dc-1255-4a4d-9ec9-35ec7d871900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f3ec85852443ec9a3cc20eae4a1bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:28Z,use_quota=True,user_id='58207a5d9b4d4a409d72bfddd0ba2336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84aa4965-a196-4838-be71-445c9974fe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84aa4965-a196-4838-be71-445c9974fe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ea5e77-b463-4788-8d56-732fe55df4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.image.glance [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Creating Keystone auth plugin from conf {{(pid=87345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ea5e77-b463-4788-8d56-732fe55df4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473', 'volume_name': 'volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473', 'volume_size': 1, 'image_id': 'd38b9e3c-4803-4dc2-937a-acf160cc5be2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d38b9e3c-4803-4dc2-937a-acf160cc5be2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe0dfb430e26a41f68ab0ad476c8a537', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e1f3ec85852443ec9a3cc20eae4a1bfb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '711927604f9d17445e7cf7ce43eee8dcfa36c5e56a3e586a1660a705cea2a9e4382bb092b85f3d1abd5b7a545c92ad34fe56e24698260fcaa95e5f1a0481127a', 'id': 'd38b9e3c-4803-4dc2-937a-acf160cc5be2', 'created_at': datetime.datetime(2026, 7, 16, 9, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 15, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d38b9e3c-4803-4dc2-937a-acf160cc5be2/file', 'properties': {}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3438bd-001f-44e4-a8f0-ae4ca1946458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3438bd-001f-44e4-a8f0-ae4ca1946458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036d3c42-b5cb-4712-a1dd-d4ba0eeffdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:28 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Volume cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473', 'volume_size': 1, 'image_id': 'd38b9e3c-4803-4dc2-937a-acf160cc5be2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d38b9e3c-4803-4dc2-937a-acf160cc5be2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe0dfb430e26a41f68ab0ad476c8a537', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e1f3ec85852443ec9a3cc20eae4a1bfb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '711927604f9d17445e7cf7ce43eee8dcfa36c5e56a3e586a1660a705cea2a9e4382bb092b85f3d1abd5b7a545c92ad34fe56e24698260fcaa95e5f1a0481127a', 'id': 'd38b9e3c-4803-4dc2-937a-acf160cc5be2', 'created_at': datetime.datetime(2026, 7, 16, 9, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 15, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d38b9e3c-4803-4dc2-937a-acf160cc5be2/file', 'properties': {}}, 'image_service': } Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Trying to clone cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 from image d38b9e3c-4803-4dc2-937a-acf160cc5be2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d38b9e3c-4803-4dc2-937a-acf160cc5be2', 'metadata': {}}]). {{(pid=87345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 11:15:28 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Image download 0.00 MB at 0.00 MB/s Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c158e3-eff2-47bb-8673-e1b21411d65c]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:28 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD Jul 16 11:15:28 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:28 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:28 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD Jul 16 11:15:28 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:29 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Temporary image d38b9e3c-4803-4dc2-937a-acf160cc5be2 is fetched for user 58207a5d9b4d4a409d72bfddd0ba2336. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbe562f-3c2c-4fcf-919a-e5120ce5b4ed]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:29 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD Jul 16 11:15:29 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:29 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:29 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD Jul 16 11:15:29 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:29 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f3ec85852443ec9a3cc20eae4a1bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:28Z,use_quota=True,user_id='58207a5d9b4d4a409d72bfddd0ba2336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Creating volume cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:29 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:29 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 1073741824 Jul 16 11:15:29 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:30 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 1073741824" returned: 0 in 0.419s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:30 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 Jul 16 11:15:30 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:30 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:30 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Attempting download of d38b9e3c-4803-4dc2-937a-acf160cc5be2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d38b9e3c-4803-4dc2-937a-acf160cc5be2', 'metadata': {}}])) to volume cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 11:15:30 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[619af242-edcb-40ad-818e-a66812fb44e8]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d38b9e3c-4803-4dc2-937a-acf160cc5be2_xyvo1r0w {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:30 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d38b9e3c-4803-4dc2-937a-acf160cc5be2_xyvo1r0w Jul 16 11:15:30 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:31 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d38b9e3c-4803-4dc2-937a-acf160cc5be2_xyvo1r0w" returned: 0 in 0.320s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d38b9e3c-4803-4dc2-937a-acf160cc5be2_xyvo1r0w {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:31 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d38b9e3c-4803-4dc2-937a-acf160cc5be2_xyvo1r0w Jul 16 11:15:31 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:31 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d38b9e3c-4803-4dc2-937a-acf160cc5be2_xyvo1r0w" returned: 1 in 0.328s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d38b9e3c-4803-4dc2-937a-acf160cc5be2_xyvo1r0w' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9d5471-886f-4c9b-a155-799fe825902a]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:31 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD Jul 16 11:15:31 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:31 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:31 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD Jul 16 11:15:31 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:31 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] d38b9e3c-4803-4dc2-937a-acf160cc5be2 was raw, converting to qcow2 {{(pid=87345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 11:15:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:32 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 Jul 16 11:15:32 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:32 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473" returned: 0 in 0.424s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d38b9e3c-4803-4dc2-937a-acf160cc5be2_cyowsx7mdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:15:32 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:32 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 1G Jul 16 11:15:32 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:32 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 1G" returned: 0 in 0.320s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Downloaded image d38b9e3c-4803-4dc2-937a-acf160cc5be2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d38b9e3c-4803-4dc2-937a-acf160cc5be2', 'metadata': {}}])) to volume cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 successfully. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Temporary image d38b9e3c-4803-4dc2-937a-acf160cc5be2 for user 58207a5d9b4d4a409d72bfddd0ba2336 is deleted. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Marking volume cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 as bootable. {{(pid=87345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Copying metadata from image d38b9e3c-4803-4dc2-937a-acf160cc5be2 to cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473. {{(pid=87345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Creating volume glance metadata for volume cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 backed by image d38b9e3c-4803-4dc2-937a-acf160cc5be2 with: {'image_id': 'd38b9e3c-4803-4dc2-937a-acf160cc5be2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fe0dfb430e26a41f68ab0ad476c8a537', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036d3c42-b5cb-4712-a1dd-d4ba0eeffdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473', 'volume_size': 1, 'image_id': 'd38b9e3c-4803-4dc2-937a-acf160cc5be2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d38b9e3c-4803-4dc2-937a-acf160cc5be2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fe0dfb430e26a41f68ab0ad476c8a537', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e1f3ec85852443ec9a3cc20eae4a1bfb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '711927604f9d17445e7cf7ce43eee8dcfa36c5e56a3e586a1660a705cea2a9e4382bb092b85f3d1abd5b7a545c92ad34fe56e24698260fcaa95e5f1a0481127a', 'id': 'd38b9e3c-4803-4dc2-937a-acf160cc5be2', 'created_at': datetime.datetime(2026, 7, 16, 9, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 15, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d38b9e3c-4803-4dc2-937a-acf160cc5be2/file', 'properties': {}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c46b69c-c3c2-4c8d-b2c7-22a3b1670719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:32 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Volume volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 (cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473): created successfully Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c46b69c-c3c2-4c8d-b2c7-22a3b1670719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Flow 'volume_create_manager' (66eed163-b0bf-4b96-99e4-1b7361f2b528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:32 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-40bde4f8-3f51-41bb-9132-c058c6acac8d tempest-VolumeImageDependencyTests-2064779434 None] Created volume successfully. Jul 16 11:15:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Acquiring lock "cinder-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Lock "cinder-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Acquiring lock "cinder-quobyte-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Lock "cinder-quobyte-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:33 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[819d408e-0121-44a6-b18b-8096bb238123]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:33 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 Jul 16 11:15:33 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:33 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473" returned: 0 in 0.347s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:33 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473 Jul 16 11:15:33 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:34 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473" returned: 0 in 0.270s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Lock "cinder-quobyte-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473" released by "delete_volume" :: held 0.664s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Created reservations ['c21d4170-10b8-43a5-b657-bcb1d7d48a4d', 'edc4f232-8770-4ed1-8a94-bb6bc3a41ad2', '51c55bfa-d000-4dd7-afb7-0aefcef7e52f', 'af96e187-de00-47b1-972d-5ed2e42139b6'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:34 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:34 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:34 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Deleted volume successfully. Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-087abb30-4970-492a-b7d2-41e492adee32 tempest-VolumeImageDependencyTests-2064779434 None] Lock "cinder-cfbf3eb9-a6e8-4718-b6a6-9bb02b67b473-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:34 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:34 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:34 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.284s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:15:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Flow 'volume_create_manager' (5331df39-bdff-45d5-bd43-8d869daec4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d596435b-968f-45d6-8dcf-bc3ff5e531ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d596435b-968f-45d6-8dcf-bc3ff5e531ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1493ae05-ac5d-4f59-896e-27c1918eca5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c4d4cd748040499478d23e25ecf362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:38Z,use_quota=True,user_id='4b6c657fb865400ca17c723df9f8ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52031920-8d18-4ec5-a44b-f15ebad05246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52031920-8d18-4ec5-a44b-f15ebad05246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9276739b-9995-4a92-ae70-e016d973c521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9276739b-9995-4a92-ae70-e016d973c521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1493ae05-ac5d-4f59-896e-27c1918eca5e', 'volume_name': 'volume-1493ae05-ac5d-4f59-896e-27c1918eca5e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0746cf-abd8-4927-a40e-ace11f5164e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0746cf-abd8-4927-a40e-ace11f5164e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ba053d-cfb9-4d81-8d39-01f0528a81d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:37 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Volume 1493ae05-ac5d-4f59-896e-27c1918eca5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1493ae05-ac5d-4f59-896e-27c1918eca5e', 'volume_size': 1} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1493ae05-ac5d-4f59-896e-27c1918eca5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c4d4cd748040499478d23e25ecf362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:38Z,use_quota=True,user_id='4b6c657fb865400ca17c723df9f8ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Creating volume 1493ae05-ac5d-4f59-896e-27c1918eca5e {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:37 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:37 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e 1073741824 Jul 16 11:15:37 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:38 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e 1073741824" returned: 0 in 0.416s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:38 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e Jul 16 11:15:38 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:38 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e" returned: 0 in 0.245s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ba053d-cfb9-4d81-8d39-01f0528a81d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1493ae05-ac5d-4f59-896e-27c1918eca5e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50801bcb-7eaf-485e-9493-19844622a479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Volume volume-1493ae05-ac5d-4f59-896e-27c1918eca5e (1493ae05-ac5d-4f59-896e-27c1918eca5e): created successfully Jul 16 11:15:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50801bcb-7eaf-485e-9493-19844622a479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Flow 'volume_create_manager' (5331df39-bdff-45d5-bd43-8d869daec4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e3305078-3539-47b0-a354-f836a5b007e3 tempest-CinderUnicodeTest-116218355 None] Created volume successfully. Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Flow 'volume_create_manager' (4a0e0270-e555-41c0-aebb-b543a960c884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1e4d8c-32c6-41a8-a09b-fd12d42c0744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1e4d8c-32c6-41a8-a09b-fd12d42c0744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-565032751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a14a23-852d-4e3d-adb4-a1dbf488f6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c4d4cd748040499478d23e25ecf362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:39Z,use_quota=True,user_id='4b6c657fb865400ca17c723df9f8ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cf12ee-0673-4d65-a208-8d49c0011ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cf12ee-0673-4d65-a208-8d49c0011ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d064b854-d440-4aca-954d-569269967ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d064b854-d440-4aca-954d-569269967ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a14a23-852d-4e3d-adb4-a1dbf488f6d3', 'volume_name': 'volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f34d47-c1b6-4386-841a-dc98933b0722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f34d47-c1b6-4386-841a-dc98933b0722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24dfa01-6684-4b50-819f-feb137b8b920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:39 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Volume 25a14a23-852d-4e3d-adb4-a1dbf488f6d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3', 'volume_size': 1} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-565032751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a14a23-852d-4e3d-adb4-a1dbf488f6d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c4d4cd748040499478d23e25ecf362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:39Z,use_quota=True,user_id='4b6c657fb865400ca17c723df9f8ef53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Creating volume 25a14a23-852d-4e3d-adb4-a1dbf488f6d3 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:39 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:39 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 1073741824 Jul 16 11:15:39 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:39 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 1073741824" returned: 0 in 0.409s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:39 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 Jul 16 11:15:39 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:39 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3" returned: 0 in 0.239s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24dfa01-6684-4b50-819f-feb137b8b920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda86400-e253-47ad-9895-c349ae787738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:39 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Volume volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 (25a14a23-852d-4e3d-adb4-a1dbf488f6d3): created successfully Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda86400-e253-47ad-9895-c349ae787738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:39 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Flow 'volume_create_manager' (4a0e0270-e555-41c0-aebb-b543a960c884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:39 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e102d178-5156-4b03-993a-4c3934f4c6fb tempest-CinderUnicodeTest-116218355 None] Created volume successfully. Jul 16 11:15:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] Creating offline snapshot c10e9fea-b845-4797-aa2a-ac4b5b99da56 of volume 25a14a23-852d-4e3d-adb4-a1dbf488f6d3 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:15:40 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8af8fe-da28-42c9-8fc4-2fadc647d403]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:40 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 Jul 16 11:15:40 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:40 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3" returned: 0 in 0.348s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:40 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 1G Jul 16 11:15:40 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:41 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 1G" returned: 0 in 0.384s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:41 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 Jul 16 11:15:41 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:41 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56" returned: 0 in 0.283s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:41 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 is being set with open permissions: ugo+rw Jul 16 11:15:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:41 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 Jul 16 11:15:41 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:41 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56" returned: 0 in 0.242s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:41 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.info Jul 16 11:15:41 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:41 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.info" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:41 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.info is being set with open permissions: ugo+rw Jul 16 11:15:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:41 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.info Jul 16 11:15:41 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:42 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.info" returned: 0 in 0.233s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:42 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b71edcdb-5939-4ea3-91a4-52e64e008264 tempest-CinderUnicodeTest-116218355 None] Create snapshot completed successfully Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "cinder-c10e9fea-b845-4797-aa2a-ac4b5b99da56-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-c10e9fea-b845-4797-aa2a-ac4b5b99da56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "cinder-quobyte-25a14a23-852d-4e3d-adb4-a1dbf488f6d3" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-quobyte-25a14a23-852d-4e3d-adb4-a1dbf488f6d3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "cinder-quobyte-c10e9fea-b845-4797-aa2a-ac4b5b99da56" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-quobyte-c10e9fea-b845-4797-aa2a-ac4b5b99da56" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Deleting offline snapshot c10e9fea-b845-4797-aa2a-ac4b5b99da56 of volume 25a14a23-852d-4e3d-adb4-a1dbf488f6d3 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] snapshot_file for this snap is: volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36ebe8c-723e-4957-8b66-e26f3e785c23]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:42 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 Jul 16 11:15:42 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:42 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56" returned: 0 in 0.345s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d814dd-e464-4406-908d-ac0d2fbd2438]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:43 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 Jul 16 11:15:43 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:43 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:43 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 Jul 16 11:15:43 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:43 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56" returned: 0 in 0.334s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:43 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56 Jul 16 11:15:43 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:43 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3.c10e9fea-b845-4797-aa2a-ac4b5b99da56" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:43 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-quobyte-c10e9fea-b845-4797-aa2a-ac4b5b99da56" released by "_delete_snapshot" :: held 1.364s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:43 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-quobyte-25a14a23-852d-4e3d-adb4-a1dbf488f6d3" released by "delete_snapshot" :: held 1.390s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:43 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Created reservations ['6ca6faf6-5d1b-4816-b530-3f92e0748cff', '4d24beed-4a95-4a8a-a7eb-a04c4fbeed53', 'd8ca650e-896a-464e-b1b7-8c954a037e21', '19d350da-8712-40af-8354-b175d1081ef5'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:44 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Delete snapshot completed successfully. Jul 16 11:15:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-901eb3a1-0a9c-450b-80ed-5677e1c998f2 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-c10e9fea-b845-4797-aa2a-ac4b5b99da56-delete_snapshot" released by "delete_snapshot" :: held 1.543s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "cinder-25a14a23-852d-4e3d-adb4-a1dbf488f6d3-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-25a14a23-852d-4e3d-adb4-a1dbf488f6d3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "cinder-quobyte-25a14a23-852d-4e3d-adb4-a1dbf488f6d3" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:44 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-quobyte-25a14a23-852d-4e3d-adb4-a1dbf488f6d3" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:44 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbc1ee8-fe4e-485a-a930-49d87619476a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:44 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 Jul 16 11:15:44 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:45 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3" returned: 0 in 0.374s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:45 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3 Jul 16 11:15:45 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:45 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-25a14a23-852d-4e3d-adb4-a1dbf488f6d3" returned: 0 in 0.235s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-quobyte-25a14a23-852d-4e3d-adb4-a1dbf488f6d3" released by "delete_volume" :: held 0.681s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Created reservations ['7b8a205d-d13d-4f08-a644-62abd9b35ef7', '5913ebf4-3842-4bce-984c-6b0bc8483a9c', 'd0f620f5-47f9-42ae-a706-da855fd242ef', 'ce301caf-ba33-4fe2-ab29-afeccec07770'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:45 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:45 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:45 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.256s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:45 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Deleted volume successfully. Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3615c88b-d15c-4422-ada1-e88a8771a698 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-25a14a23-852d-4e3d-adb4-a1dbf488f6d3-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "cinder-1493ae05-ac5d-4f59-896e-27c1918eca5e-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-1493ae05-ac5d-4f59-896e-27c1918eca5e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "cinder-quobyte-1493ae05-ac5d-4f59-896e-27c1918eca5e" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-quobyte-1493ae05-ac5d-4f59-896e-27c1918eca5e" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cab90b7-8eb3-48fc-94b1-29c4ad3d35c0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:46 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e Jul 16 11:15:46 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:46 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e" returned: 0 in 0.361s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:46 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e Jul 16 11:15:46 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:46 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1493ae05-ac5d-4f59-896e-27c1918eca5e" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-quobyte-1493ae05-ac5d-4f59-896e-27c1918eca5e" released by "delete_volume" :: held 0.652s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Created reservations ['0ff5cf85-5ce3-4232-bd57-74b094ddab28', 'f659fd79-961b-456a-a32a-2c89024f9fc8', '67304d1a-1286-49c0-85a8-7bf95be2bdd8', 'ff873d7d-68d7-495b-ac9a-8c7859e38780'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:46 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:46 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:46 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.261s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:46 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Deleted volume successfully. Jul 16 11:15:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b8453dd5-ed54-4ca2-9cd4-b452be38d924 tempest-CinderUnicodeTest-116218355 None] Lock "cinder-1493ae05-ac5d-4f59-896e-27c1918eca5e-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-42ac8bab-1a97-4cd6-800f-e965f16f9a08 req-2964cafa-743b-4769-9a00-1a7a9fa02a2a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-42ac8bab-1a97-4cd6-800f-e965f16f9a08 req-2964cafa-743b-4769-9a00-1a7a9fa02a2a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-42ac8bab-1a97-4cd6-800f-e965f16f9a08 req-2964cafa-743b-4769-9a00-1a7a9fa02a2a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-42ac8bab-1a97-4cd6-800f-e965f16f9a08 req-2964cafa-743b-4769-9a00-1a7a9fa02a2a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1bc1b5fd-d539-493f-89ab-aeaa9984c516', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:15:48 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-42ac8bab-1a97-4cd6-800f-e965f16f9a08 req-2964cafa-743b-4769-9a00-1a7a9fa02a2a tempest-TestServerVolumeAttachmentScenario-1715352164 None] attachment_update completed successfully. Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Flow 'volume_create_manager' (6bccc783-e481-470d-9d46-9be37d05fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592160f0-03cf-4a5d-a13a-19e041e4e210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592160f0-03cf-4a5d-a13a-19e041e4e210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-796884132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b64fa7-d1ea-4681-8405-d1bf98152251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b336e81266cb49eba44d3e3821162ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:51Z,use_quota=True,user_id='2189219762c34daeb04e17f502c63997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f8a2c2-399d-41be-b53e-7d7c9375c5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f8a2c2-399d-41be-b53e-7d7c9375c5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684a3d18-d601-4cc4-9291-6f75dfba45a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684a3d18-d601-4cc4-9291-6f75dfba45a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b64fa7-d1ea-4681-8405-d1bf98152251', 'volume_name': 'volume-b6b64fa7-d1ea-4681-8405-d1bf98152251', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e18286f-1db2-43b6-bd47-5712cce28a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e18286f-1db2-43b6-bd47-5712cce28a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ec7438-0c53-48c6-8600-0bd5460b2dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:50 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Volume b6b64fa7-d1ea-4681-8405-d1bf98152251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b64fa7-d1ea-4681-8405-d1bf98152251', 'volume_size': 1} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-796884132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b64fa7-d1ea-4681-8405-d1bf98152251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b336e81266cb49eba44d3e3821162ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:51Z,use_quota=True,user_id='2189219762c34daeb04e17f502c63997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Creating volume b6b64fa7-d1ea-4681-8405-d1bf98152251 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:50 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:50 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251 1073741824 Jul 16 11:15:50 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:51 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251 1073741824" returned: 0 in 0.430s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:51 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251 Jul 16 11:15:51 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:51 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251" returned: 0 in 0.248s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:51 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ec7438-0c53-48c6-8600-0bd5460b2dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b64fa7-d1ea-4681-8405-d1bf98152251', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bef33c-84c9-41c2-a55b-41f072c584ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:51 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Volume volume-b6b64fa7-d1ea-4681-8405-d1bf98152251 (b6b64fa7-d1ea-4681-8405-d1bf98152251): created successfully Jul 16 11:15:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44bef33c-84c9-41c2-a55b-41f072c584ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:51 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Flow 'volume_create_manager' (6bccc783-e481-470d-9d46-9be37d05fa91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:51 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9ed6453b-9116-47cc-95bb-aaee7de8f528 tempest-ProjectReaderTests-1215028670 None] Created volume successfully. Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Acquiring lock "cinder-b6b64fa7-d1ea-4681-8405-d1bf98152251-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Lock "cinder-b6b64fa7-d1ea-4681-8405-d1bf98152251-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Acquiring lock "cinder-quobyte-b6b64fa7-d1ea-4681-8405-d1bf98152251" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Lock "cinder-quobyte-b6b64fa7-d1ea-4681-8405-d1bf98152251" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25974c2-1204-4bef-963e-297da1668300]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:52 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251 Jul 16 11:15:52 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-f242657f-ba0f-4c6f-966d-8511156385f2 req-b404ddae-e952-4135-8733-5dd3cc7c9f81 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-f242657f-ba0f-4c6f-966d-8511156385f2 req-b404ddae-e952-4135-8733-5dd3cc7c9f81 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-f242657f-ba0f-4c6f-966d-8511156385f2 req-b404ddae-e952-4135-8733-5dd3cc7c9f81 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-f242657f-ba0f-4c6f-966d-8511156385f2 req-b404ddae-e952-4135-8733-5dd3cc7c9f81 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acf65e5f-a73f-476b-9d92-a1ad117e4c45', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:15:52 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-f242657f-ba0f-4c6f-966d-8511156385f2 req-b404ddae-e952-4135-8733-5dd3cc7c9f81 tempest-TestServerVolumeAttachmentScenario-1715352164 None] attachment_update completed successfully. Jul 16 11:15:52 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251" returned: 0 in 0.383s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:52 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251 Jul 16 11:15:52 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:52 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b6b64fa7-d1ea-4681-8405-d1bf98152251" returned: 0 in 0.271s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Lock "cinder-quobyte-b6b64fa7-d1ea-4681-8405-d1bf98152251" released by "delete_volume" :: held 0.703s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Created reservations ['88fa50a2-1032-48de-950c-8d8be2fd0021', 'b1bcf8ee-f7df-4df4-ae5c-682679902adc', '7c8cb808-501d-4ae8-844c-07a54faa6599', 'addb4533-5c2d-4668-99cf-696dcc65e159'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:52 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:52 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:53 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:53 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Deleted volume successfully. Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b4803204-96f2-42d2-bbfd-d6caaa940a57 tempest-ProjectReaderTests-1215028670 None] Lock "cinder-b6b64fa7-d1ea-4681-8405-d1bf98152251-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Flow 'volume_create_manager' (9b7b8cfe-7e61-403b-92ce-2a091e5eb171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af15ca7-66a1-4582-b197-af536932d8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af15ca7-66a1-4582-b197-af536932d8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986188642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2e427a-143d-408a-8a7a-e6b853af1ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b336e81266cb49eba44d3e3821162ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:54Z,use_quota=True,user_id='2189219762c34daeb04e17f502c63997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f789d8-9f21-4983-84c8-3e06b0686f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f789d8-9f21-4983-84c8-3e06b0686f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a766cc5c-ec06-40c3-af35-145156b282a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a766cc5c-ec06-40c3-af35-145156b282a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d2e427a-143d-408a-8a7a-e6b853af1ec5', 'volume_name': 'volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a7592f-a667-4660-a367-49e9a7940b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a7592f-a667-4660-a367-49e9a7940b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6648ae-479a-4e43-9544-a4601fc8edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:53 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Volume 0d2e427a-143d-408a-8a7a-e6b853af1ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5', 'volume_size': 1} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986188642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2e427a-143d-408a-8a7a-e6b853af1ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b336e81266cb49eba44d3e3821162ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:54Z,use_quota=True,user_id='2189219762c34daeb04e17f502c63997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Creating volume 0d2e427a-143d-408a-8a7a-e6b853af1ec5 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:53 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:53 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5 1073741824 Jul 16 11:15:53 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:54 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-6fdacfab-4fd6-4731-bc0e-26e39076f819 req-d959d486-1362-4ccc-b2dd-15c1c687d30d tempest-TestServerVolumeAttachmentScenario-1715352164 None] Terminate volume connection completed successfully. Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-6fdacfab-4fd6-4731-bc0e-26e39076f819 req-d959d486-1362-4ccc-b2dd-15c1c687d30d tempest-TestServerVolumeAttachmentScenario-1715352164 None] Deleting attachment acf65e5f-a73f-476b-9d92-a1ad117e4c45. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:15:54 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5 1073741824" returned: 0 in 0.470s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:54 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5 Jul 16 11:15:54 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:54 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5" returned: 0 in 0.239s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6648ae-479a-4e43-9544-a4601fc8edab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c4fc3f-cebe-47d9-a09f-e8724f11b304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:54 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Volume volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5 (0d2e427a-143d-408a-8a7a-e6b853af1ec5): created successfully Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c4fc3f-cebe-47d9-a09f-e8724f11b304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Flow 'volume_create_manager' (9b7b8cfe-7e61-403b-92ce-2a091e5eb171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:54 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-bcc15d82-4417-4e2f-9dd2-3c65cc55999d tempest-ProjectReaderTests-1215028670 None] Created volume successfully. Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Acquiring lock "cinder-0d2e427a-143d-408a-8a7a-e6b853af1ec5-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Lock "cinder-0d2e427a-143d-408a-8a7a-e6b853af1ec5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Acquiring lock "cinder-quobyte-0d2e427a-143d-408a-8a7a-e6b853af1ec5" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Lock "cinder-quobyte-0d2e427a-143d-408a-8a7a-e6b853af1ec5" acquired by "delete_volume" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6a0585-9367-4a19-b11a-e89bebc98f3e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:54 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5 Jul 16 11:15:54 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:55 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5" returned: 0 in 0.365s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:55 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5 Jul 16 11:15:55 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:55 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0d2e427a-143d-408a-8a7a-e6b853af1ec5" returned: 0 in 0.261s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Lock "cinder-quobyte-0d2e427a-143d-408a-8a7a-e6b853af1ec5" released by "delete_volume" :: held 0.664s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Created reservations ['f07e08fb-2926-4804-b5fc-37dfcc8326b2', '2f4b9e90-8301-4748-ab76-af836c3c1eed', '762e503a-ee74-45a7-b526-dbf192928aae', 'a16ff111-7255-481b-bfdd-b701e2c59c06'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:55 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-e0d20e12-39f8-4b4a-8b26-f890d97877f8 req-902accc4-7205-444f-b261-ba0feb87cb27 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Terminate volume connection completed successfully. Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-e0d20e12-39f8-4b4a-8b26-f890d97877f8 req-902accc4-7205-444f-b261-ba0feb87cb27 tempest-TestServerVolumeAttachmentScenario-1715352164 None] Deleting attachment 1bc1b5fd-d539-493f-89ab-aeaa9984c516. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:15:55 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:55 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:55 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.256s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:55 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Deleted volume successfully. Jul 16 11:15:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-cbec39d9-71fa-41b0-813a-24c367334d21 tempest-ProjectReaderTests-1215028670 None] Lock "cinder-0d2e427a-143d-408a-8a7a-e6b853af1ec5-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Flow 'volume_create_manager' (7134980b-d2d2-4776-aff1-91dcb1b713df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a7d6df-3d81-4787-9af6-296f2c7f7271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a7d6df-3d81-4787-9af6-296f2c7f7271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1397641700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbbf20e-1c9e-4b41-b72b-daeac1c68d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b336e81266cb49eba44d3e3821162ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:56Z,use_quota=True,user_id='2189219762c34daeb04e17f502c63997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cbcc3d-d2ba-468c-ad90-ef1efa858e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47cbcc3d-d2ba-468c-ad90-ef1efa858e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d247808-ec9c-4f3d-87f1-f27a65bb6087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d247808-ec9c-4f3d-87f1-f27a65bb6087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bbbf20e-1c9e-4b41-b72b-daeac1c68d64', 'volume_name': 'volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6fdcea4-aaba-4da1-8b33-d72ed49856a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6fdcea4-aaba-4da1-8b33-d72ed49856a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313b9f41-6b44-4a96-a487-de5a54aaf54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:56 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Volume 9bbbf20e-1c9e-4b41-b72b-daeac1c68d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64', 'volume_size': 1} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1397641700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbbf20e-1c9e-4b41-b72b-daeac1c68d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b336e81266cb49eba44d3e3821162ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:15:56Z,use_quota=True,user_id='2189219762c34daeb04e17f502c63997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Creating volume 9bbbf20e-1c9e-4b41-b72b-daeac1c68d64 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:15:56 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:56 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64 1073741824 Jul 16 11:15:56 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:56 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64 1073741824" returned: 0 in 0.470s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:56 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64 Jul 16 11:15:56 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:57 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64" returned: 0 in 0.360s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:15:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313b9f41-6b44-4a96-a487-de5a54aaf54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e091f39a-4f04-4e59-b698-3fa8cb0d1a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:15:57 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Volume volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64 (9bbbf20e-1c9e-4b41-b72b-daeac1c68d64): created successfully Jul 16 11:15:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e091f39a-4f04-4e59-b698-3fa8cb0d1a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:15:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Flow 'volume_create_manager' (7134980b-d2d2-4776-aff1-91dcb1b713df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:15:57 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c5a1bb9a-511a-453b-a775-0b154eb86400 tempest-ProjectReaderTests-1215028670 None] Created volume successfully. Jul 16 11:15:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Acquiring lock "cinder-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Lock "cinder-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Acquiring lock "cinder-quobyte-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:15:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Lock "cinder-quobyte-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:15:58 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8742a3-5142-46d2-bebd-376b48d3e9f5]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:15:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:58 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64 Jul 16 11:15:58 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:58 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64" returned: 0 in 0.368s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:58 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64 Jul 16 11:15:58 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:59 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64" returned: 0 in 0.254s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Lock "cinder-quobyte-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64" released by "delete_volume" :: held 0.670s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Created reservations ['82bf4504-34be-4495-aaca-21784575c463', 'dba5292e-bd4d-4b34-b8b2-5f57c0d1800c', '9a389f11-3899-415f-b489-c23b808c3b15', '5f084423-991a-4c54-b9e4-39754d249701'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:15:59 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:15:59 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:15:59 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.289s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:15:59 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Deleted volume successfully. Jul 16 11:15:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-fc017ce0-8e97-4db4-922c-c23172a2896e tempest-ProjectReaderTests-1215028670 None] Lock "cinder-9bbbf20e-1c9e-4b41-b72b-daeac1c68d64-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Flow 'volume_create_manager' (0febd89f-82b9-40b3-8c9b-90576e50bb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0deaadb6-c20c-4f4e-84f7-f184eb5e713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "cinder-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0deaadb6-c20c-4f4e-84f7-f184eb5e713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-315237712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e800d3b-fa65-4123-a9e2-d8619175f174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b336e81266cb49eba44d3e3821162ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:16:00Z,use_quota=True,user_id='2189219762c34daeb04e17f502c63997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a964e31-d67a-4891-81de-5347245ab986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a964e31-d67a-4891-81de-5347245ab986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140725db-c29b-48ba-81be-21e0b622875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140725db-c29b-48ba-81be-21e0b622875c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e800d3b-fa65-4123-a9e2-d8619175f174', 'volume_name': 'volume-9e800d3b-fa65-4123-a9e2-d8619175f174', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52397fa5-790a-4390-9781-b6ced560d52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52397fa5-790a-4390-9781-b6ced560d52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a80af67-81c5-4fae-a777-55159cf47833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:00 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Volume 9e800d3b-fa65-4123-a9e2-d8619175f174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e800d3b-fa65-4123-a9e2-d8619175f174', 'volume_size': 1} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-315237712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e800d3b-fa65-4123-a9e2-d8619175f174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b336e81266cb49eba44d3e3821162ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:16:00Z,use_quota=True,user_id='2189219762c34daeb04e17f502c63997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Creating volume 9e800d3b-fa65-4123-a9e2-d8619175f174 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:16:00 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "cinder-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=122,cinder:INSERT=40,cinder:UPDATE=163,cinder:DELETE=10 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:16:00 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174 1073741824 Jul 16 11:16:00 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "cinder-quobyte-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "cinder-quobyte-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a30ee9f-52a4-4bab-9584-590528d0e0d0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:00 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4 Jul 16 11:16:00 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:00 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174 1073741824" returned: 0 in 0.449s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:00 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4" returned: 0 in 0.366s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=136,cinder:UPDATE=154,cinder:INSERT=41,cinder:DELETE=18 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:16:00 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4 Jul 16 11:16:00 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:00 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174 Jul 16 11:16:00 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:00 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4" returned: 0 in 0.242s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "cinder-quobyte-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4" released by "delete_volume" :: held 0.648s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:00 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174" returned: 0 in 0.243s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a80af67-81c5-4fae-a777-55159cf47833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e800d3b-fa65-4123-a9e2-d8619175f174', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efa442e-8d20-42ad-961a-65481ce93270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:00 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Volume volume-9e800d3b-fa65-4123-a9e2-d8619175f174 (9e800d3b-fa65-4123-a9e2-d8619175f174): created successfully Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efa442e-8d20-42ad-961a-65481ce93270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:00 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Flow 'volume_create_manager' (0febd89f-82b9-40b3-8c9b-90576e50bb67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:16:01 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-175ec04d-b48e-4433-a715-17ee06fba6bf tempest-ProjectReaderTests-1215028670 None] Created volume successfully. Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Created reservations ['e3dd47e8-fc57-4251-a741-c281e4d38e32', 'c6c155d9-6739-4ed0-a33d-089e287d855c', '9c28a0c0-00cc-455d-8bf5-934d6641e4ce', '875cdc41-e392-4f1c-83e1-8b4e5b7ce954'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:01 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:16:01 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Acquiring lock "cinder-9e800d3b-fa65-4123-a9e2-d8619175f174-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Lock "cinder-9e800d3b-fa65-4123-a9e2-d8619175f174-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Acquiring lock "cinder-quobyte-9e800d3b-fa65-4123-a9e2-d8619175f174" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Lock "cinder-quobyte-9e800d3b-fa65-4123-a9e2-d8619175f174" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b1ad6-230e-407c-9fdf-e67299e57edc]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "cinder-4cd7548f-c6aa-4171-883b-ad71da3da4bf-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "cinder-4cd7548f-c6aa-4171-883b-ad71da3da4bf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "cinder-quobyte-4cd7548f-c6aa-4171-883b-ad71da3da4bf" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "cinder-quobyte-4cd7548f-c6aa-4171-883b-ad71da3da4bf" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:01 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:01 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174 Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.314s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:01 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:16:01 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Deleted volume successfully. Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[97643321-b035-489e-8388-e01734183d76]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3a6dd029-b355-4973-bf23-8404b45b951e tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "cinder-1daa2a78-4e48-44cb-83f6-a9447dfbf9d4-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:01 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf Jul 16 11:16:01 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:01 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174" returned: 0 in 0.379s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:01 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174 Jul 16 11:16:01 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:01 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf" returned: 0 in 0.377s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:01 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf Jul 16 11:16:01 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:01 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9e800d3b-fa65-4123-a9e2-d8619175f174" returned: 0 in 0.235s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Lock "cinder-quobyte-9e800d3b-fa65-4123-a9e2-d8619175f174" released by "delete_volume" :: held 0.661s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:01 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Created reservations ['91e1b60f-4bf7-4e07-8d0f-8d6a1b4ad9b8', 'db634ded-ef26-465d-a86f-8e310e58d78b', 'b3d767de-577f-40f3-8f42-7028745421ac', '5e225ca2-1b1c-429b-b0a5-e2408f0fcc18'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:02 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:16:02 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:02 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4cd7548f-c6aa-4171-883b-ad71da3da4bf" returned: 0 in 0.266s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "cinder-quobyte-4cd7548f-c6aa-4171-883b-ad71da3da4bf" released by "delete_volume" :: held 0.690s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Created reservations ['359c1ce3-7285-40cb-bd8f-74fe038467c7', 'a8d9cf23-9a21-460e-854f-a87e3a3764a2', '02a4099a-461c-4b44-972e-19b1a3ad37ad', '159420e9-abc0-4b70-b63d-cf1b443742a4'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:02 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:16:02 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:02 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.271s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:16:02 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Deleted volume successfully. Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c0b9085b-7c94-4e3d-81b4-ae9adceecb6e tempest-ProjectReaderTests-1215028670 None] Lock "cinder-9e800d3b-fa65-4123-a9e2-d8619175f174-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:02 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.275s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:16:02 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Deleted volume successfully. Jul 16 11:16:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f7aad743-1250-4c20-bbbd-9fdbcdafee0a tempest-TestServerVolumeAttachmentScenario-1715352164 None] Lock "cinder-4cd7548f-c6aa-4171-883b-ad71da3da4bf-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:12 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=13,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:16:12 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=17,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Flow 'volume_create_manager' (9d82135f-8d61-4ee9-b350-8f123b0894db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a409bbd-0643-4192-a5b7-657d49574e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a409bbd-0643-4192-a5b7-657d49574e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1805134082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10415c53-0509-4187-9501-02c1c1b052c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe15cf74489544c5a6887683562599f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:16:23Z,use_quota=True,user_id='e5159af13e7e463fabc1aa8bf36a2e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d97f19-626d-4852-908e-92f9efdc2372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d97f19-626d-4852-908e-92f9efdc2372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e3bc2d-32e8-4c8d-8a64-ecd537b26877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e3bc2d-32e8-4c8d-8a64-ecd537b26877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10415c53-0509-4187-9501-02c1c1b052c5', 'volume_name': 'volume-10415c53-0509-4187-9501-02c1c1b052c5', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a312c7d8-4b8b-4bbf-9c47-1cd9471231e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a312c7d8-4b8b-4bbf-9c47-1cd9471231e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd177688-56f9-43b3-b207-1ee5aa86f039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:23 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Volume 10415c53-0509-4187-9501-02c1c1b052c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10415c53-0509-4187-9501-02c1c1b052c5', 'volume_size': 1} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1805134082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10415c53-0509-4187-9501-02c1c1b052c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe15cf74489544c5a6887683562599f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:16:23Z,use_quota=True,user_id='e5159af13e7e463fabc1aa8bf36a2e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Creating volume 10415c53-0509-4187-9501-02c1c1b052c5 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:16:23 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:23 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 1073741824 Jul 16 11:16:23 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:23 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 1073741824" returned: 0 in 0.444s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:23 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 Jul 16 11:16:23 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:24 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5" returned: 0 in 0.248s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd177688-56f9-43b3-b207-1ee5aa86f039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10415c53-0509-4187-9501-02c1c1b052c5', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791fc411-bccf-422a-9361-4e57e2fb8764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:24 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Volume volume-10415c53-0509-4187-9501-02c1c1b052c5 (10415c53-0509-4187-9501-02c1c1b052c5): created successfully Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791fc411-bccf-422a-9361-4e57e2fb8764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Flow 'volume_create_manager' (9d82135f-8d61-4ee9-b350-8f123b0894db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:16:24 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e4370560-a436-4943-a354-d74691ef9726 tempest-SnapshotDependencyTests-1569338853 None] Created volume successfully. Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] Creating offline snapshot ab43300e-4f44-4959-abfb-7b8640b74f30 of volume 10415c53-0509-4187-9501-02c1c1b052c5 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29b14d4-2519-43ad-928b-24773da90557]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:16:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:24 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 Jul 16 11:16:24 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:25 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5" returned: 0 in 0.366s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:25 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 1G Jul 16 11:16:25 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:25 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 1G" returned: 0 in 0.414s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10415c53-0509-4187-9501-02c1c1b052c5 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:25 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10415c53-0509-4187-9501-02c1c1b052c5 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 Jul 16 11:16:25 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:25 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10415c53-0509-4187-9501-02c1c1b052c5 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30" returned: 0 in 0.289s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:25 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 is being set with open permissions: ugo+rw Jul 16 11:16:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:25 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 Jul 16 11:16:25 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:25 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30" returned: 0 in 0.283s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:26 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.info Jul 16 11:16:26 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:26 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.info" returned: 0 in 0.402s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:26 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.info is being set with open permissions: ugo+rw Jul 16 11:16:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:26 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.info Jul 16 11:16:26 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:26 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.info" returned: 0 in 0.458s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a0b1bdcc-9b3d-41db-abab-eb307ccbaf20 tempest-SnapshotDependencyTests-1569338853 None] Create snapshot completed successfully Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Flow 'volume_create_manager' (d31d876c-fdef-4785-ad88-18c8d1e78e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803240ac-b4e0-443c-b22e-b07c360a9794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803240ac-b4e0-443c-b22e-b07c360a9794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824ccf84-96e2-47b1-ae80-f486ca8f8854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe15cf74489544c5a6887683562599f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ab43300e-4f44-4959-abfb-7b8640b74f30,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:16:28Z,use_quota=True,user_id='e5159af13e7e463fabc1aa8bf36a2e7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4144d633-37f4-4efd-b115-1db986ff5172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4144d633-37f4-4efd-b115-1db986ff5172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dc3c70-286a-48d9-8cc7-59ca6af94a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9dc3c70-286a-48d9-8cc7-59ca6af94a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '824ccf84-96e2-47b1-ae80-f486ca8f8854', 'volume_name': 'volume-824ccf84-96e2-47b1-ae80-f486ca8f8854', 'volume_size': 1, 'snapshot_id': 'ab43300e-4f44-4959-abfb-7b8640b74f30'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43f0d80-5b7f-4add-a83b-7523bf426e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43f0d80-5b7f-4add-a83b-7523bf426e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d73826-4b9b-4ed4-9878-68db572b070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:28 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Volume 824ccf84-96e2-47b1-ae80-f486ca8f8854: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-824ccf84-96e2-47b1-ae80-f486ca8f8854', 'volume_size': 1, 'snapshot_id': 'ab43300e-4f44-4959-abfb-7b8640b74f30'} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "cinder-quobyte-ab43300e-4f44-4959-abfb-7b8640b74f30-824ccf84-96e2-47b1-ae80-f486ca8f8854" by "_create_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-ab43300e-4f44-4959-abfb-7b8640b74f30-824ccf84-96e2-47b1-ae80-f486ca8f8854" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Creating volume 824ccf84-96e2-47b1-ae80-f486ca8f8854 from snapshot ab43300e-4f44-4959-abfb-7b8640b74f30 {{(pid=87345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "cinder-quobyte-824ccf84-96e2-47b1-ae80-f486ca8f8854" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-824ccf84-96e2-47b1-ae80-f486ca8f8854" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] snapshot: ab43300e-4f44-4959-abfb-7b8640b74f30, volume: 824ccf84-96e2-47b1-ae80-f486ca8f8854, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9080e008-09b9-475c-86bb-eb55a1fb5d39]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:28 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 Jul 16 11:16:28 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:28 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30" returned: 0 in 0.381s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10415c53-0509-4187-9501-02c1c1b052c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:16:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:16:29 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b285d83-3c61-4a3a-8b19-675730981240]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:16:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:29 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 Jul 16 11:16:29 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:29 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5" returned: 0 in 0.414s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:29 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:16:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:29 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 Jul 16 11:16:29 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:34 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854" returned: 0 in 4.696s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0868e50-53ad-4754-b490-fc64f0caa61b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:34 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 Jul 16 11:16:34 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:34 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5" returned: 0 in 0.551s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5, size 1024.00 MB, duration 4.70 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:16:34 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Converted 1024.00 MB image at 218.00 MB/s Jul 16 11:16:34 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 is being set with open permissions: ugo+rw Jul 16 11:16:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:34 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:16:34 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:34 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 Jul 16 11:16:34 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:35 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.350s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:16:35 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854" returned: 0 in 0.392s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-824ccf84-96e2-47b1-ae80-f486ca8f8854" released by "_copy_volume_from_snapshot" :: held 6.533s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-ab43300e-4f44-4959-abfb-7b8640b74f30-824ccf84-96e2-47b1-ae80-f486ca8f8854" released by "_create_volume_from_snapshot" :: held 6.572s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.592s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d73826-4b9b-4ed4-9878-68db572b070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824ccf84-96e2-47b1-ae80-f486ca8f8854', 'volume_size': 1, 'snapshot_id': 'ab43300e-4f44-4959-abfb-7b8640b74f30'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1e493b-f506-4ddd-b06c-693f6cc5336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:35 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Volume volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 (824ccf84-96e2-47b1-ae80-f486ca8f8854): created successfully Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1e493b-f506-4ddd-b06c-693f6cc5336a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Flow 'volume_create_manager' (d31d876c-fdef-4785-ad88-18c8d1e78e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:16:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-72b58596-089f-48c2-ba89-f02bd575ea8a tempest-SnapshotDependencyTests-1569338853 None] Created volume successfully. Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "cinder-ab43300e-4f44-4959-abfb-7b8640b74f30-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-ab43300e-4f44-4959-abfb-7b8640b74f30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "cinder-quobyte-10415c53-0509-4187-9501-02c1c1b052c5" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-10415c53-0509-4187-9501-02c1c1b052c5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "cinder-quobyte-ab43300e-4f44-4959-abfb-7b8640b74f30" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-ab43300e-4f44-4959-abfb-7b8640b74f30" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Deleting offline snapshot ab43300e-4f44-4959-abfb-7b8640b74f30 of volume 10415c53-0509-4187-9501-02c1c1b052c5 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] snapshot_file for this snap is: volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[280f4bbc-83ee-4759-abf2-92b70aa00076]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:36 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 Jul 16 11:16:36 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:36 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30" returned: 0 in 0.371s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10415c53-0509-4187-9501-02c1c1b052c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b989b372-373a-4c30-b6d6-8937c9f0cacc]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:16:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:36 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 Jul 16 11:16:36 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:37 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5" returned: 0 in 0.403s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:37 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 Jul 16 11:16:37 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:37 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30" returned: 0 in 0.354s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:37 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30 Jul 16 11:16:37 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:37 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5.ab43300e-4f44-4959-abfb-7b8640b74f30" returned: 0 in 0.271s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-ab43300e-4f44-4959-abfb-7b8640b74f30" released by "_delete_snapshot" :: held 1.523s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-10415c53-0509-4187-9501-02c1c1b052c5" released by "delete_snapshot" :: held 1.549s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:37 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Created reservations ['5286d571-99db-49de-bd0a-2fe3083f03d8', 'b2fd58b3-57f3-4636-b269-831e4e9cb7a6', '8a0bdc06-5b8e-4005-8437-64302ef3a855', '50ea91b7-dd7c-43d4-b895-ac069bc87d32'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:16:37 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Delete snapshot completed successfully. Jul 16 11:16:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3ca11322-533a-4902-91e6-af390d47d8b6 tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-ab43300e-4f44-4959-abfb-7b8640b74f30-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "cinder-10415c53-0509-4187-9501-02c1c1b052c5-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-10415c53-0509-4187-9501-02c1c1b052c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "cinder-quobyte-10415c53-0509-4187-9501-02c1c1b052c5" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-10415c53-0509-4187-9501-02c1c1b052c5" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:38 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[369fade1-0b3d-46b4-a287-eeedffadd4b0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:16:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:38 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 Jul 16 11:16:38 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:38 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5" returned: 0 in 0.357s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:38 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5 Jul 16 11:16:38 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:39 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-10415c53-0509-4187-9501-02c1c1b052c5" returned: 0 in 0.291s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-10415c53-0509-4187-9501-02c1c1b052c5" released by "delete_volume" :: held 0.727s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Created reservations ['07dc1443-9bdc-440c-872f-6b081881a98c', '3c1c2f53-9cfa-4090-aaae-fab9113da61b', '502cb0f4-6395-425f-932c-caf1bdcccb1a', '744c4a61-392e-4d56-96c1-adf1f73dc23e'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:39 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:16:39 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "cinder-824ccf84-96e2-47b1-ae80-f486ca8f8854-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-824ccf84-96e2-47b1-ae80-f486ca8f8854-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:39 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.298s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:16:39 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Deleted volume successfully. Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6eb68fad-38b8-416f-98e0-b84123e74b93 tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-10415c53-0509-4187-9501-02c1c1b052c5-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "cinder-quobyte-824ccf84-96e2-47b1-ae80-f486ca8f8854" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-824ccf84-96e2-47b1-ae80-f486ca8f8854" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c766e796-116a-449b-b538-a5aecc06bbce]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:16:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:39 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 Jul 16 11:16:39 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:40 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854" returned: 0 in 0.448s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:40 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854 Jul 16 11:16:40 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:40 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-824ccf84-96e2-47b1-ae80-f486ca8f8854" returned: 0 in 0.283s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-quobyte-824ccf84-96e2-47b1-ae80-f486ca8f8854" released by "delete_volume" :: held 0.798s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Created reservations ['e8ef39d8-a15c-4854-84c1-39ea72958ad3', '7993c98c-5087-47c6-99d7-67613b120db3', '83e21b83-59e6-4143-a8e8-ab758def9301', 'bc0d4aee-baeb-41c6-a611-7012b2cb5fba'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:40 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:16:40 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:40 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.280s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:16:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Deleted volume successfully. Jul 16 11:16:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-ef51af4d-dab3-4bf9-ab26-e0a6353b9eaa tempest-SnapshotDependencyTests-1569338853 None] Lock "cinder-824ccf84-96e2-47b1-ae80-f486ca8f8854-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Flow 'volume_create_manager' (fb484504-fa3b-4bb8-a1c9-180430f565e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f0fe08-62a4-40b0-95f2-d761b3ffaee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f0fe08-62a4-40b0-95f2-d761b3ffaee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1972428092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527ee9b2-0509-4ce4-86b2-3e1e2b6dab03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1262cfa5fa740a6a4f460424cc8f890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:16:43Z,use_quota=True,user_id='9ca45bfddd304b10ab51e95947b7021c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a886b2f3-cfa2-4174-96bc-616cf326babd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a886b2f3-cfa2-4174-96bc-616cf326babd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638123e0-9d73-4a2e-b986-c9b4267c5832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638123e0-9d73-4a2e-b986-c9b4267c5832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '527ee9b2-0509-4ce4-86b2-3e1e2b6dab03', 'volume_name': 'volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee05473-964e-4270-8fe1-07797271fb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee05473-964e-4270-8fe1-07797271fb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14dc8f5-1c0c-4592-86cc-c3700a696510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:43 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Volume 527ee9b2-0509-4ce4-86b2-3e1e2b6dab03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03', 'volume_size': 1} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1972428092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=527ee9b2-0509-4ce4-86b2-3e1e2b6dab03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1262cfa5fa740a6a4f460424cc8f890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:16:43Z,use_quota=True,user_id='9ca45bfddd304b10ab51e95947b7021c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Creating volume 527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:16:43 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:43 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 1073741824 Jul 16 11:16:43 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:43 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 1073741824" returned: 0 in 0.584s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:16:43 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 Jul 16 11:16:43 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:16:44 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Jul 16 11:16:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" returned: 0 in 0.282s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:16:44 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:16:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:16:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14dc8f5-1c0c-4592-86cc-c3700a696510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5a5772-446f-42b7-a5e8-20406392cf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:16:44 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Volume volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 (527ee9b2-0509-4ce4-86b2-3e1e2b6dab03): created successfully Jul 16 11:16:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5a5772-446f-42b7-a5e8-20406392cf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:16:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Flow 'volume_create_manager' (fb484504-fa3b-4bb8-a1c9-180430f565e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:16:44 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-18e661b3-4a7d-462a-b7cd-0f8954de7d0f tempest-TestStampPattern-1029396271 None] Created volume successfully. Jul 16 11:16:54 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=24,cinder:UPDATE=36,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:16:54 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=26,cinder:SELECT=27,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:17:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c676d6a7-66a6-4a39-9bb4-828e9cda606c req-9099bc33-ec34-4239-a6cf-c18107c0e731 tempest-TestStampPattern-1029396271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:17:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c676d6a7-66a6-4a39-9bb4-828e9cda606c req-9099bc33-ec34-4239-a6cf-c18107c0e731 tempest-TestStampPattern-1029396271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:17:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-c676d6a7-66a6-4a39-9bb4-828e9cda606c req-9099bc33-ec34-4239-a6cf-c18107c0e731 tempest-TestStampPattern-1029396271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:17:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-c676d6a7-66a6-4a39-9bb4-828e9cda606c req-9099bc33-ec34-4239-a6cf-c18107c0e731 tempest-TestStampPattern-1029396271 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '927c660e-b104-4b3b-ae53-e93015597fcb', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:17:14 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-c676d6a7-66a6-4a39-9bb4-828e9cda606c req-9099bc33-ec34-4239-a6cf-c18107c0e731 tempest-TestStampPattern-1029396271 None] attachment_update completed successfully. Jul 16 11:17:18 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-b9f60ca1-5278-4870-b150-f25c5edca061 req-49e4cb4a-07b3-4969-95bf-f2997eaf943c tempest-TestStampPattern-1029396271 None] Terminate volume connection completed successfully. Jul 16 11:17:18 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-b9f60ca1-5278-4870-b150-f25c5edca061 req-49e4cb4a-07b3-4969-95bf-f2997eaf943c tempest-TestStampPattern-1029396271 None] Deleting attachment 927c660e-b104-4b3b-ae53-e93015597fcb. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:17:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:17:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:17:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] Creating offline snapshot 6ee84b50-61f7-48b7-b888-f11d33665d86 of volume 527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:17:19 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[99889288-a0a0-424f-8c8b-13c170f1d296]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:17:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:19 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 Jul 16 11:17:19 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:19 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" returned: 0 in 0.352s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:19 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 1G Jul 16 11:17:19 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:20 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 1G" returned: 0 in 0.385s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:20 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 Jul 16 11:17:20 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:20 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86" returned: 0 in 0.289s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:20 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 is being set with open permissions: ugo+rw Jul 16 11:17:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:20 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 Jul 16 11:17:20 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:20 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86" returned: 0 in 0.245s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:20 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.info Jul 16 11:17:20 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:20 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.info" returned: 0 in 0.243s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:20 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.info is being set with open permissions: ugo+rw Jul 16 11:17:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:21 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.info Jul 16 11:17:21 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:21 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.info" returned: 0 in 0.242s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:17:21 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-92248fdf-ae06-400b-8bc0-94e1cd1dad22 tempest-TestStampPattern-1029396271 None] Create snapshot completed successfully Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Flow 'volume_create_manager' (8e32eed9-048f-48e3-b71d-4f48c8ee2d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7548b9f5-7952-4c99-9eb4-5f75f45f144e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7548b9f5-7952-4c99-9eb4-5f75f45f144e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1731489009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb730184-5577-4c2e-b1cd-1b4f90377238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1262cfa5fa740a6a4f460424cc8f890',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ee84b50-61f7-48b7-b888-f11d33665d86,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:17:28Z,use_quota=True,user_id='9ca45bfddd304b10ab51e95947b7021c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdeb91fa-fcc8-4e11-9442-e54556cbe9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdeb91fa-fcc8-4e11-9442-e54556cbe9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca07b6a-2908-42d9-bbd2-76e0f55a2e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca07b6a-2908-42d9-bbd2-76e0f55a2e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb730184-5577-4c2e-b1cd-1b4f90377238', 'volume_name': 'volume-bb730184-5577-4c2e-b1cd-1b4f90377238', 'volume_size': 1, 'snapshot_id': '6ee84b50-61f7-48b7-b888-f11d33665d86'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7d7191-3967-4c71-ac46-b8c0c916cc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7d7191-3967-4c71-ac46-b8c0c916cc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32f79b5-ee45-46a3-8eed-9fdd3a0fb748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:17:28 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Volume bb730184-5577-4c2e-b1cd-1b4f90377238: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb730184-5577-4c2e-b1cd-1b4f90377238', 'volume_size': 1, 'snapshot_id': '6ee84b50-61f7-48b7-b888-f11d33665d86'} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Acquiring lock "cinder-quobyte-6ee84b50-61f7-48b7-b888-f11d33665d86-bb730184-5577-4c2e-b1cd-1b4f90377238" by "_create_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-6ee84b50-61f7-48b7-b888-f11d33665d86-bb730184-5577-4c2e-b1cd-1b4f90377238" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Creating volume bb730184-5577-4c2e-b1cd-1b4f90377238 from snapshot 6ee84b50-61f7-48b7-b888-f11d33665d86 {{(pid=87345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Acquiring lock "cinder-quobyte-bb730184-5577-4c2e-b1cd-1b4f90377238" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-bb730184-5577-4c2e-b1cd-1b4f90377238" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] snapshot: 6ee84b50-61f7-48b7-b888-f11d33665d86, volume: bb730184-5577-4c2e-b1cd-1b4f90377238, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ea19d0-8baf-4414-9463-50206f073c7e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:28 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 Jul 16 11:17:28 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:28 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86" returned: 0 in 0.397s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ae42f7-aa29-4e0d-8787-f3c22c9ab1ca]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:17:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:28 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 Jul 16 11:17:28 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:29 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" returned: 0 in 0.383s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:29 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:17:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:29 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 Jul 16 11:17:29 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:34 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:17:34 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:34 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238" returned: 0 in 5.710s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f90ee-085b-422c-8e6e-1c6b18672a44]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:34 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 Jul 16 11:17:34 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:34 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.261s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:17:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:17:35 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" returned: 0 in 0.596s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:35 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:17:35 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Converted 1024.00 MB image at 179.28 MB/s Jul 16 11:17:35 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 is being set with open permissions: ugo+rw Jul 16 11:17:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:17:35 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 Jul 16 11:17:35 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:17:35 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Jul 16 11:17:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:17:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-bb730184-5577-4c2e-b1cd-1b4f90377238" released by "_copy_volume_from_snapshot" :: held 7.537s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:17:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-6ee84b50-61f7-48b7-b888-f11d33665d86-bb730184-5577-4c2e-b1cd-1b4f90377238" released by "_create_volume_from_snapshot" :: held 7.573s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:17:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.589s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:17:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32f79b5-ee45-46a3-8eed-9fdd3a0fb748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb730184-5577-4c2e-b1cd-1b4f90377238', 'volume_size': 1, 'snapshot_id': '6ee84b50-61f7-48b7-b888-f11d33665d86'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:17:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe945795-cbd3-440c-8f9a-644bfd0c9ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:17:35 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Volume volume-bb730184-5577-4c2e-b1cd-1b4f90377238 (bb730184-5577-4c2e-b1cd-1b4f90377238): created successfully Jul 16 11:17:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe945795-cbd3-440c-8f9a-644bfd0c9ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:17:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Flow 'volume_create_manager' (8e32eed9-048f-48e3-b71d-4f48c8ee2d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:17:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-bc469e5f-06c2-4921-8382-0819cca6477b tempest-TestStampPattern-1029396271 None] Created volume successfully. Jul 16 11:17:45 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:17:49 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:18:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-ba6483c6-fedb-426f-902c-c567c53deacd req-d3003a53-409a-49a5-9b3f-fd98391b4854 tempest-TestStampPattern-1029396271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:18:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-ba6483c6-fedb-426f-902c-c567c53deacd req-d3003a53-409a-49a5-9b3f-fd98391b4854 tempest-TestStampPattern-1029396271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:18:16 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7069bc6a-e67f-4ebd-82dc-9b5833982bc1]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:18:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-ba6483c6-fedb-426f-902c-c567c53deacd req-d3003a53-409a-49a5-9b3f-fd98391b4854 tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:16 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 Jul 16 11:18:16 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:17 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [req-ba6483c6-fedb-426f-902c-c567c53deacd req-d3003a53-409a-49a5-9b3f-fd98391b4854 tempest-TestStampPattern-1029396271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238" returned: 0 in 0.346s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [req-ba6483c6-fedb-426f-902c-c567c53deacd req-d3003a53-409a-49a5-9b3f-fd98391b4854 tempest-TestStampPattern-1029396271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.372s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:18:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-ba6483c6-fedb-426f-902c-c567c53deacd req-d3003a53-409a-49a5-9b3f-fd98391b4854 tempest-TestStampPattern-1029396271 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20', 'name': 'volume-bb730184-5577-4c2e-b1cd-1b4f90377238', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bb1ddb1-595d-4a3c-a13f-1d3fc01b5b9e', 'enforce_multipath': True} {{(pid=87345) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 11:18:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-ba6483c6-fedb-426f-902c-c567c53deacd req-d3003a53-409a-49a5-9b3f-fd98391b4854 tempest-TestStampPattern-1029396271 None] attachment_update completed successfully. Jul 16 11:18:19 devstack cinder-volume[87345]: INFO cinder.volume.manager [req-778c3244-85f4-44fa-8fbd-e1d850d545a4 req-0cf81958-595c-4456-b8a9-fdf58b3dfcc9 tempest-TestStampPattern-1029396271 None] Terminate volume connection completed successfully. Jul 16 11:18:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [req-778c3244-85f4-44fa-8fbd-e1d850d545a4 req-0cf81958-595c-4456-b8a9-fdf58b3dfcc9 tempest-TestStampPattern-1029396271 None] Deleting attachment 6bb1ddb1-595d-4a3c-a13f-1d3fc01b5b9e. {{(pid=87345) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 11:18:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Acquiring lock "cinder-bb730184-5577-4c2e-b1cd-1b4f90377238-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:18:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Lock "cinder-bb730184-5577-4c2e-b1cd-1b4f90377238-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:18:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Acquiring lock "cinder-quobyte-bb730184-5577-4c2e-b1cd-1b4f90377238" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-bb730184-5577-4c2e-b1cd-1b4f90377238" acquired by "delete_volume" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cd8346-bf83-4f00-bcf1-919333e65076]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:24 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 Jul 16 11:18:24 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:24 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238" returned: 0 in 0.349s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:24 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238 Jul 16 11:18:24 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:24 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-bb730184-5577-4c2e-b1cd-1b4f90377238" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-bb730184-5577-4c2e-b1cd-1b4f90377238" released by "delete_volume" :: held 0.628s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Created reservations ['3adb0085-2654-4638-b5ff-0b676f29bcd4', 'c9d78114-f013-4e73-b49f-e8a1bfbaac0c', 'a4b3a8dc-3f7d-486f-a16e-0a7ab2a55410', '3dac8bf1-6db3-4e69-b01c-3be5b023ef18'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:24 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:18:24 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:24 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:24 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:18:24 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Deleted volume successfully. Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d73befdf-99b7-49ef-8a64-fdb8a1c9630c tempest-TestStampPattern-1029396271 None] Lock "cinder-bb730184-5577-4c2e-b1cd-1b4f90377238-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Acquiring lock "cinder-6ee84b50-61f7-48b7-b888-f11d33665d86-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Lock "cinder-6ee84b50-61f7-48b7-b888-f11d33665d86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Acquiring lock "cinder-quobyte-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Acquiring lock "cinder-quobyte-6ee84b50-61f7-48b7-b888-f11d33665d86" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-6ee84b50-61f7-48b7-b888-f11d33665d86" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Deleting offline snapshot 6ee84b50-61f7-48b7-b888-f11d33665d86 of volume 527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] snapshot_file for this snap is: volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0427bb7a-5c25-4abd-92fb-a55653988b1a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:25 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 Jul 16 11:18:25 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:25 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86" returned: 0 in 0.357s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6f5f79-e4a7-4265-b44b-07f34568ca41]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:18:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:25 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 Jul 16 11:18:25 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:26 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" returned: 0 in 0.346s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:26 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 Jul 16 11:18:26 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:26 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86" returned: 0 in 0.330s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:26 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86 Jul 16 11:18:26 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:26 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03.6ee84b50-61f7-48b7-b888-f11d33665d86" returned: 0 in 0.235s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-6ee84b50-61f7-48b7-b888-f11d33665d86" released by "_delete_snapshot" :: held 1.358s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:18:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" released by "delete_snapshot" :: held 1.381s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:18:26 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Created reservations ['e32bc967-6f06-42d3-a711-c1ab93ffd92d', '996dbf4d-561e-4f6a-96db-0b622dfc7929', '85c9c189-9a8d-4ece-9445-9827f6ad39b1', 'f925e039-d1ca-48b8-908c-25cc751a20ec'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:18:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Delete snapshot completed successfully. Jul 16 11:18:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-df857983-6734-4a08-b580-f1805fdb179a tempest-TestStampPattern-1029396271 None] Lock "cinder-6ee84b50-61f7-48b7-b888-f11d33665d86-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:18:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Acquiring lock "cinder-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:18:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Lock "cinder-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:18:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Acquiring lock "cinder-quobyte-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:18:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:18:30 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d62a256-b54e-48d6-9a7f-cd13dcd23913]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:18:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:31 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 Jul 16 11:18:31 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:31 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:31 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03 Jul 16 11:18:31 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:31 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" returned: 0 in 0.233s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Lock "cinder-quobyte-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03" released by "delete_volume" :: held 0.628s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Created reservations ['79956d7e-89e0-460c-9e89-cc5617d7e644', '79fbff2f-0cb9-4e73-a306-cb166030311f', 'dfb97ac6-ce23-49d7-9559-087ac292f16a', '1c1db0f5-5315-4ee2-a1ef-256c4c91034d'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:31 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:18:31 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:31 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.233s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:18:31 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Deleted volume successfully. Jul 16 11:18:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4705ef04-d42c-4cc1-9ecc-ef22d41463fc tempest-TestStampPattern-1029396271 None] Lock "cinder-527ee9b2-0509-4ce4-86b2-3e1e2b6dab03-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:34 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:18:34 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:34 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.259s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:18:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:18:41 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=15,cinder:UPDATE=25,cinder:INSERT=6 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:18:41 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=31,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Flow 'volume_create_manager' (7419e658-73b2-4f5a-bfd9-a6842f815556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb34fa00-a811-4ea1-89d9-f7900d6da75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb34fa00-a811-4ea1-89d9-f7900d6da75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1735f26-d5ae-4f8c-8861-2ff20fad5c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417855c63b049bea5ff222c2e77174f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:18:44Z,use_quota=True,user_id='5cea636311ed4c0daa706b4211caae5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c6916fb-3015-4100-9b50-0fbcf8f322ee),volume_type_id=8c6916fb-3015-4100-9b50-0fbcf8f322ee)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e72ff4-2ea9-41ec-9b6b-0306d5384c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e72ff4-2ea9-41ec-9b6b-0306d5384c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d976a8-c6c1-48e8-9000-ff4f51944c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.image.glance [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Creating Keystone auth plugin from conf {{(pid=87345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d976a8-c6c1-48e8-9000-ff4f51944c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a1735f26-d5ae-4f8c-8861-2ff20fad5c6a', 'volume_name': 'volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a', 'volume_size': 1, 'image_id': '114fe463-37aa-4560-8840-3235e6d06042', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/114fe463-37aa-4560-8840-3235e6d06042', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8163d2ecd9a47d0b1852dfd09cc1ac34', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7417855c63b049bea5ff222c2e77174f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9d9c7b13276ab4f566748a0b053b6b07530fbe6808b43092d72c6a286a6efa9712a20c9bfd12aeb3a2347ad9db4dc5837bbaf3f23a10d3ce6a22d331b38f9dc', 'id': '114fe463-37aa-4560-8840-3235e6d06042', 'created_at': datetime.datetime(2026, 7, 16, 9, 18, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 18, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/114fe463-37aa-4560-8840-3235e6d06042/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1865c4a8-664c-4c58-a7df-dc3df97b8faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1865c4a8-664c-4c58-a7df-dc3df97b8faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2927a4ed-cd28-4adb-a439-5381bb158b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:18:44 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Volume a1735f26-d5ae-4f8c-8861-2ff20fad5c6a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a', 'volume_size': 1, 'image_id': '114fe463-37aa-4560-8840-3235e6d06042', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/114fe463-37aa-4560-8840-3235e6d06042', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8163d2ecd9a47d0b1852dfd09cc1ac34', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7417855c63b049bea5ff222c2e77174f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9d9c7b13276ab4f566748a0b053b6b07530fbe6808b43092d72c6a286a6efa9712a20c9bfd12aeb3a2347ad9db4dc5837bbaf3f23a10d3ce6a22d331b38f9dc', 'id': '114fe463-37aa-4560-8840-3235e6d06042', 'created_at': datetime.datetime(2026, 7, 16, 9, 18, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 18, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/114fe463-37aa-4560-8840-3235e6d06042/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Trying to clone a1735f26-d5ae-4f8c-8861-2ff20fad5c6a from image 114fe463-37aa-4560-8840-3235e6d06042 at location (None, [{'url': 'file:///opt/stack/data/glance/images/114fe463-37aa-4560-8840-3235e6d06042', 'metadata': {}}]). {{(pid=87345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 11:18:44 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Image download 0.00 MB at 0.00 MB/s Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d0f119-d735-40e5-849e-98cb884842c6]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:18:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:44 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD Jul 16 11:18:44 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:45 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD" returned: 0 in 0.308s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:45 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD Jul 16 11:18:45 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:45 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD" returned: 1 in 0.312s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:18:45 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Temporary image 114fe463-37aa-4560-8840-3235e6d06042 is fetched for user 5cea636311ed4c0daa706b4211caae5a. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 11:18:45 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf4b9ba-a787-424c-98fe-735e8b704de0]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:18:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:45 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD Jul 16 11:18:45 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:45 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD" returned: 0 in 0.309s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:45 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD Jul 16 11:18:45 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:46 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD" returned: 1 in 0.307s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1735f26-d5ae-4f8c-8861-2ff20fad5c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7417855c63b049bea5ff222c2e77174f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:18:44Z,use_quota=True,user_id='5cea636311ed4c0daa706b4211caae5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c6916fb-3015-4100-9b50-0fbcf8f322ee),volume_type_id=8c6916fb-3015-4100-9b50-0fbcf8f322ee)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Creating volume a1735f26-d5ae-4f8c-8861-2ff20fad5c6a {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:18:46 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:46 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a 1073741824 Jul 16 11:18:46 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:46 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a 1073741824" returned: 0 in 0.392s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:46 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a Jul 16 11:18:46 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:46 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a" returned: 0 in 0.232s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Attempting download of 114fe463-37aa-4560-8840-3235e6d06042 ((None, [{'url': 'file:///opt/stack/data/glance/images/114fe463-37aa-4560-8840-3235e6d06042', 'metadata': {}}])) to volume a1735f26-d5ae-4f8c-8861-2ff20fad5c6a. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[598ed7c7-ea51-4bf4-bddd-5125fbf14f51]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:18:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_114fe463-37aa-4560-8840-3235e6d06042_n4jo92bt {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:46 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_114fe463-37aa-4560-8840-3235e6d06042_n4jo92bt Jul 16 11:18:46 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:47 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_114fe463-37aa-4560-8840-3235e6d06042_n4jo92bt" returned: 0 in 0.306s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_114fe463-37aa-4560-8840-3235e6d06042_n4jo92bt {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:47 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_114fe463-37aa-4560-8840-3235e6d06042_n4jo92bt Jul 16 11:18:47 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:47 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_114fe463-37aa-4560-8840-3235e6d06042_n4jo92bt" returned: 1 in 0.319s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_114fe463-37aa-4560-8840-3235e6d06042_n4jo92bt' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:18:47 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12ed418-ed43-4f54-ae93-2468e1152c55]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:18:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:47 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD Jul 16 11:18:47 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:47 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:47 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD Jul 16 11:18:47 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:48 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD" returned: 1 in 0.313s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] 114fe463-37aa-4560-8840-3235e6d06042 was raw, converting to qcow2 {{(pid=87345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:48 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a Jul 16 11:18:48 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:48 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a" returned: 0 in 0.449s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_114fe463-37aa-4560-8840-3235e6d06042_jm_ksa1sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:18:48 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:48 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a 1G Jul 16 11:18:48 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:48 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a 1G" returned: 0 in 0.292s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Downloaded image 114fe463-37aa-4560-8840-3235e6d06042 ((None, [{'url': 'file:///opt/stack/data/glance/images/114fe463-37aa-4560-8840-3235e6d06042', 'metadata': {}}])) to volume a1735f26-d5ae-4f8c-8861-2ff20fad5c6a successfully. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Temporary image 114fe463-37aa-4560-8840-3235e6d06042 for user 5cea636311ed4c0daa706b4211caae5a is deleted. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Marking volume a1735f26-d5ae-4f8c-8861-2ff20fad5c6a as bootable. {{(pid=87345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Copying metadata from image 114fe463-37aa-4560-8840-3235e6d06042 to a1735f26-d5ae-4f8c-8861-2ff20fad5c6a. {{(pid=87345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Creating volume glance metadata for volume a1735f26-d5ae-4f8c-8861-2ff20fad5c6a backed by image 114fe463-37aa-4560-8840-3235e6d06042 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '114fe463-37aa-4560-8840-3235e6d06042', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8163d2ecd9a47d0b1852dfd09cc1ac34', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2927a4ed-cd28-4adb-a439-5381bb158b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a', 'volume_size': 1, 'image_id': '114fe463-37aa-4560-8840-3235e6d06042', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/114fe463-37aa-4560-8840-3235e6d06042', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8163d2ecd9a47d0b1852dfd09cc1ac34', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7417855c63b049bea5ff222c2e77174f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9d9c7b13276ab4f566748a0b053b6b07530fbe6808b43092d72c6a286a6efa9712a20c9bfd12aeb3a2347ad9db4dc5837bbaf3f23a10d3ce6a22d331b38f9dc', 'id': '114fe463-37aa-4560-8840-3235e6d06042', 'created_at': datetime.datetime(2026, 7, 16, 9, 18, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 18, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/114fe463-37aa-4560-8840-3235e6d06042/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06985fd9-8d5c-4a6d-a075-f32900dd7a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:18:48 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Volume volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a (a1735f26-d5ae-4f8c-8861-2ff20fad5c6a): created successfully Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06985fd9-8d5c-4a6d-a075-f32900dd7a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:18:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Flow 'volume_create_manager' (7419e658-73b2-4f5a-bfd9-a6842f815556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:18:49 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-1f0058bf-07f4-42ae-a7ed-3af622310cb0 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Created volume successfully. Jul 16 11:18:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Acquiring lock "cinder-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:18:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Lock "cinder-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:18:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Acquiring lock "cinder-quobyte-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:18:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Lock "cinder-quobyte-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a" acquired by "delete_volume" :: waited 0.012s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:18:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7def53-fd67-4909-a81b-df932d5d89fb]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:18:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:49 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a Jul 16 11:18:49 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:50 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a" returned: 0 in 0.336s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:50 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a Jul 16 11:18:50 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:50 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a" returned: 0 in 0.243s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Lock "cinder-quobyte-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a" released by "delete_volume" :: held 0.613s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:18:50 devstack cinder-volume[87345]: WARNING cinder.quota [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:18:50 devstack cinder-volume[87345]: WARNING cinder.quota [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Created reservations ['392e83be-d544-42c4-acaa-e24f2cf39009', 'bcb4b362-d4a5-458f-bc66-cbb9af92a03b', 'e6b97584-ba86-4342-98e8-82daf9d41028', 'd58983bd-f799-45e4-a96b-772e79884165'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:18:50 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:18:50 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:18:50 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.231s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:18:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Deleted volume successfully. Jul 16 11:18:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-24eb090e-bdc0-4a15-a392-7f96ab96db82 tempest-VolumeAndVolumeTypeFromImageTest-1245659056 None] Lock "cinder-a1735f26-d5ae-4f8c-8861-2ff20fad5c6a-delete_volume" released by "delete_volume" :: held 1.033s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:00 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=11,cinder:INSERT=9,cinder:UPDATE=12 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:19:00 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=13,cinder:SELECT=15,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (593cac7b-c531-41ba-a06b-62b14bd56ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88efa61f-5902-458e-ae59-78f6890a3060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88efa61f-5902-458e-ae59-78f6890a3060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-92797384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7b9f87-be60-49bf-bdba-e21afb4487cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:07Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1779e95-bf42-4355-ae32-d0640cd68a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1779e95-bf42-4355-ae32-d0640cd68a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7c3b9b-f730-4d0a-b1eb-f9af03da8021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7c3b9b-f730-4d0a-b1eb-f9af03da8021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7b9f87-be60-49bf-bdba-e21afb4487cf', 'volume_name': 'volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01063d28-3c83-45ad-9b77-64baf1f9d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01063d28-3c83-45ad-9b77-64baf1f9d23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145977cc-1a91-44bb-aea4-53f1a0f78d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume ea7b9f87-be60-49bf-bdba-e21afb4487cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf', 'volume_size': 1} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-92797384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7b9f87-be60-49bf-bdba-e21afb4487cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:07Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Creating volume ea7b9f87-be60-49bf-bdba-e21afb4487cf {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:07 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:07 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf 1073741824 Jul 16 11:19:07 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Flow 'volume_create_manager' (dc1f36ec-efe5-4668-9c3b-848164644aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594ac627-1e2e-4c3c-a93f-618759666a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594ac627-1e2e-4c3c-a93f-618759666a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1779080392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac88377ecaad416aae7280612cb64a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:08Z,use_quota=True,user_id='cc46c603b08a46c5886dfd5cdf53f230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25570711-cfa5-40d6-8b09-ffff2c45c841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25570711-cfa5-40d6-8b09-ffff2c45c841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82ac820-b833-4c70-8412-f8f6fcb8eb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82ac820-b833-4c70-8412-f8f6fcb8eb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6', 'volume_name': 'volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355a4404-4beb-4490-bf8b-1ec9370001c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355a4404-4beb-4490-bf8b-1ec9370001c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f80818-a444-4006-bad1-30cb8f4d5759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Volume 06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6', 'volume_size': 1} Jul 16 11:19:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (2952d9b9-4591-4805-927d-579b03068f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0e3035-0d64-4375-b089-2d1e68bb5eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0e3035-0d64-4375-b089-2d1e68bb5eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230613740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bcd125-8b61-414a-9cc9-98c8466ab158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:08Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b98610c-cfce-4e39-a37a-df840f1719de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b98610c-cfce-4e39-a37a-df840f1719de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662fced9-3a80-45d8-b910-50d5222089e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662fced9-3a80-45d8-b910-50d5222089e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bcd125-8b61-414a-9cc9-98c8466ab158', 'volume_name': 'volume-d2bcd125-8b61-414a-9cc9-98c8466ab158', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49afec6-cd5f-4d5a-b811-9786db88e104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49afec6-cd5f-4d5a-b811-9786db88e104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90f8718-c8c5-41e0-a53d-91215a23c21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume d2bcd125-8b61-414a-9cc9-98c8466ab158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bcd125-8b61-414a-9cc9-98c8466ab158', 'volume_size': 1} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:08 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf 1073741824" returned: 0 in 0.766s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Flow 'volume_create_manager' (db0970f3-3f7f-405d-a94c-16b75d0df2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c995391-311b-4736-8890-60f2a6a673fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c995391-311b-4736-8890-60f2a6a673fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732586025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b8b1bd-3699-48d8-bbe2-208c7c7e829f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac88377ecaad416aae7280612cb64a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:08Z,use_quota=True,user_id='cc46c603b08a46c5886dfd5cdf53f230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5af43a9-448d-4f9f-a251-17140c97661f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5af43a9-448d-4f9f-a251-17140c97661f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44115871-3017-4dfc-a657-a60427ad3457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf Jul 16 11:19:08 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44115871-3017-4dfc-a657-a60427ad3457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b8b1bd-3699-48d8-bbe2-208c7c7e829f', 'volume_name': 'volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3f106e-7f2c-46c4-a1f5-dca83177268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3f106e-7f2c-46c4-a1f5-dca83177268c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3eba58f-34dc-4c94-8267-cb5a09a0a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Volume d0b8b1bd-3699-48d8-bbe2-208c7c7e829f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f', 'volume_size': 1} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:08 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Flow 'volume_create_manager' (dbf1da1f-e5dc-41fd-bc4b-9a77547d933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89d099e-a382-4a59-a148-37904324c6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf" returned: 0 in 0.402s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.796s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1779080392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac88377ecaad416aae7280612cb64a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:08Z,use_quota=True,user_id='cc46c603b08a46c5886dfd5cdf53f230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Creating volume 06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:08 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89d099e-a382-4a59-a148-37904324c6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076659307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a14b3a-b730-4833-a987-ae757ab74dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac88377ecaad416aae7280612cb64a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:09Z,use_quota=True,user_id='cc46c603b08a46c5886dfd5cdf53f230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b46869-1925-4a3b-b3f6-16c06d5a6a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6 1073741824 Jul 16 11:19:08 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b46869-1925-4a3b-b3f6-16c06d5a6a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2201a62d-20af-4948-9040-2297971f7d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2201a62d-20af-4948-9040-2297971f7d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a14b3a-b730-4833-a987-ae757ab74dc7', 'volume_name': 'volume-15a14b3a-b730-4833-a987-ae757ab74dc7', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0cecef-9f1f-4388-b16f-afb91d637679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0cecef-9f1f-4388-b16f-afb91d637679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d40dff-dba1-47de-93a9-6ef1e6b272d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Volume 15a14b3a-b730-4833-a987-ae757ab74dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a14b3a-b730-4833-a987-ae757ab74dc7', 'volume_size': 1} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145977cc-1a91-44bb-aea4-53f1a0f78d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9f6b99-ebb9-4c3b-81b4-67d0b4ecc8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf (ea7b9f87-be60-49bf-bdba-e21afb4487cf): created successfully Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9f6b99-ebb9-4c3b-81b4-67d0b4ecc8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (593cac7b-c531-41ba-a06b-62b14bd56ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:08 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-41a27ba4-d3f6-4d3e-9578-423aad640232 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created volume successfully. Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Flow 'volume_create_manager' (ae500cd5-847e-41af-aa98-6b5e7d21ea58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694a9071-4376-464f-b815-3363928894b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (694a9071-4376-464f-b815-3363928894b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-530073611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d0d826-1478-441f-bdbc-77773b57e183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac88377ecaad416aae7280612cb64a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:09Z,use_quota=True,user_id='cc46c603b08a46c5886dfd5cdf53f230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475b9a0e-4771-4061-b0fc-cdec2dd24b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475b9a0e-4771-4061-b0fc-cdec2dd24b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398f6319-58bc-47e9-b070-937e03052e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398f6319-58bc-47e9-b070-937e03052e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d0d826-1478-441f-bdbc-77773b57e183', 'volume_name': 'volume-e9d0d826-1478-441f-bdbc-77773b57e183', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf614955-1e76-41e9-9cb3-5a5ce46adae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf614955-1e76-41e9-9cb3-5a5ce46adae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accce3a7-fe86-4aff-8c05-120e62692661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Volume e9d0d826-1478-441f-bdbc-77773b57e183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d0d826-1478-441f-bdbc-77773b57e183', 'volume_size': 1} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:09 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6 1073741824" returned: 0 in 0.556s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:09 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6 Jul 16 11:19:09 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Flow 'volume_create_manager' (d187627b-3ef0-406b-9ac2-4f015766bf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281807f6-eb07-4a70-8785-358e800ed771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281807f6-eb07-4a70-8785-358e800ed771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1341838681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66a393b-315e-43f0-9e5c-47ff4ed6d104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac88377ecaad416aae7280612cb64a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:10Z,use_quota=True,user_id='cc46c603b08a46c5886dfd5cdf53f230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:09 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cda233-1814-4351-a571-b7a506886ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cda233-1814-4351-a571-b7a506886ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b03564c-2ac4-4baa-a462-05d0fbc64f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b03564c-2ac4-4baa-a462-05d0fbc64f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66a393b-315e-43f0-9e5c-47ff4ed6d104', 'volume_name': 'volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956f7a78-9943-4dd6-8127-644c5f18d9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956f7a78-9943-4dd6-8127-644c5f18d9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53871314-3ed7-41c2-98a7-d4cc8d89546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Volume d66a393b-315e-43f0-9e5c-47ff4ed6d104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104', 'volume_size': 1} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6" returned: 0 in 0.313s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230613740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bcd125-8b61-414a-9cc9-98c8466ab158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:08Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Creating volume d2bcd125-8b61-414a-9cc9-98c8466ab158 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:09 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:09 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 1073741824 Jul 16 11:19:09 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f80818-a444-4006-bad1-30cb8f4d5759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9a27c8-4ca6-4bf6-a5f4-d45440612c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Volume volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6 (06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6): created successfully Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9a27c8-4ca6-4bf6-a5f4-d45440612c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Flow 'volume_create_manager' (dc1f36ec-efe5-4668-9c3b-848164644aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5920f9a6-a685-48c5-85e0-9439527ca3d4 tempest-CreateVolumesFromImageTest-1179210377 None] Created volume successfully. Jul 16 11:19:10 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 1073741824" returned: 0 in 0.486s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:10 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 Jul 16 11:19:10 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (89b10b37-42ca-4351-807e-b8d9ee9acd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a33333b-620b-4ea2-9de9-9ab0cbca7ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a33333b-620b-4ea2-9de9-9ab0cbca7ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-684101822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5820c86-987a-4648-b9e6-3cdba9228b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:10Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b462dc0-7dcb-4b38-8acc-f541272df87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b462dc0-7dcb-4b38-8acc-f541272df87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db34f7b8-8f5c-4bdd-b5f6-e37721c96e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db34f7b8-8f5c-4bdd-b5f6-e37721c96e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5820c86-987a-4648-b9e6-3cdba9228b6d', 'volume_name': 'volume-a5820c86-987a-4648-b9e6-3cdba9228b6d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408388d1-44cf-4fd4-bbab-415ba0d0eecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408388d1-44cf-4fd4-bbab-415ba0d0eecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73bdd870-95a5-4031-abe6-167df5bd77a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:10 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume a5820c86-987a-4648-b9e6-3cdba9228b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5820c86-987a-4648-b9e6-3cdba9228b6d', 'volume_size': 1} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:10 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158" returned: 0 in 0.380s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.226s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732586025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b8b1bd-3699-48d8-bbe2-208c7c7e829f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac88377ecaad416aae7280612cb64a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:08Z,use_quota=True,user_id='cc46c603b08a46c5886dfd5cdf53f230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Creating volume d0b8b1bd-3699-48d8-bbe2-208c7c7e829f {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:10 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90f8718-c8c5-41e0-a53d-91215a23c21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bcd125-8b61-414a-9cc9-98c8466ab158', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19259696-b02f-4074-9d70-297b581f1f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:10 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f 1073741824 Jul 16 11:19:10 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:10 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 (d2bcd125-8b61-414a-9cc9-98c8466ab158): created successfully Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19259696-b02f-4074-9d70-297b581f1f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (2952d9b9-4591-4805-927d-579b03068f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:10 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-222e87a4-d970-488e-a666-51f9fd9728dd tempest-CreateVolumesFromSnapshotTest-499515465 None] Created volume successfully. Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (9b3ad529-8dad-4e98-95b6-2d0c8a1666d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f9c0eb-6dc7-4881-85a8-80b657ed3c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f9c0eb-6dc7-4881-85a8-80b657ed3c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-811218640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:11Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09653c2b-ff81-4413-944d-e57723726b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09653c2b-ff81-4413-944d-e57723726b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967bc2b2-3ca5-43ff-add3-34420b4dba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967bc2b2-3ca5-43ff-add3-34420b4dba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b', 'volume_name': 'volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bbe033-314f-456f-90c0-86e3e0362c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bbe033-314f-456f-90c0-86e3e0362c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8dc8f7-23a6-46e2-aa56-cf024e59c2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:10 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b', 'volume_size': 1} Jul 16 11:19:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (dcd52a5c-f146-4824-b675-5f42020f6a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb13a57-73f0-4135-9f04-2da83efb2cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb13a57-73f0-4135-9f04-2da83efb2cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1604883879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c61ded5-7985-43d3-a00a-3fdab7798c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:11Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380909cc-0399-4e70-825a-f12bad1255f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380909cc-0399-4e70-825a-f12bad1255f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:11 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34f7799-0c8e-4bbb-9033-dd2aeef43872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34f7799-0c8e-4bbb-9033-dd2aeef43872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c61ded5-7985-43d3-a00a-3fdab7798c74', 'volume_name': 'volume-3c61ded5-7985-43d3-a00a-3fdab7798c74', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa20af99-01e4-40b9-8492-a17f1bbfa5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa20af99-01e4-40b9-8492-a17f1bbfa5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5c3680-fe4c-4695-8364-7e5376230bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:11 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume 3c61ded5-7985-43d3-a00a-3fdab7798c74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c61ded5-7985-43d3-a00a-3fdab7798c74', 'volume_size': 1} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f 1073741824" returned: 0 in 0.637s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:11 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f Jul 16 11:19:11 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:11 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f" returned: 0 in 0.275s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.763s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076659307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a14b3a-b730-4833-a987-ae757ab74dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac88377ecaad416aae7280612cb64a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:09Z,use_quota=True,user_id='cc46c603b08a46c5886dfd5cdf53f230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Creating volume 15a14b3a-b730-4833-a987-ae757ab74dc7 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:11 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:11 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7 1073741824 Jul 16 11:19:11 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (2627cfe1-133a-41aa-968b-d7090a5d82c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7cd7e6-7f18-4985-98f1-56433ae6f9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3eba58f-34dc-4c94-8267-cb5a09a0a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936f80b7-d0d8-4cb5-aa77-67afee2d7913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7cd7e6-7f18-4985-98f1-56433ae6f9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1171186213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303ea2e0-fa4f-41f2-90ac-76013c3fb1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:12Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7848928-8398-4c9f-a353-77ac34f58036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7848928-8398-4c9f-a353-77ac34f58036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d5b7cc-f89d-48f0-8bcf-2c12dc2e0f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d5b7cc-f89d-48f0-8bcf-2c12dc2e0f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '303ea2e0-fa4f-41f2-90ac-76013c3fb1df', 'volume_name': 'volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c532706-c25c-4cd1-8445-7e063576d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c532706-c25c-4cd1-8445-7e063576d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26535494-20ac-4754-a931-ef123c848c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:11 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume 303ea2e0-fa4f-41f2-90ac-76013c3fb1df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df', 'volume_size': 1} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:11 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Volume volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f (d0b8b1bd-3699-48d8-bbe2-208c7c7e829f): created successfully Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936f80b7-d0d8-4cb5-aa77-67afee2d7913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:11 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Flow 'volume_create_manager' (db0970f3-3f7f-405d-a94c-16b75d0df2ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:11 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-582a1c8d-f5b1-464b-b0b7-5cefa24e93f8 tempest-CreateVolumesFromImageTest-1179210377 None] Created volume successfully. Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Flow 'volume_create_manager' (278f7817-5b3a-4081-9929-4f341802478e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:12 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857ba2d9-241e-4d35-8668-11e515d06e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7 1073741824" returned: 0 in 0.576s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857ba2d9-241e-4d35-8668-11e515d06e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d279b0-00b9-48db-98ea-83f0c0a80958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a18d998c8448a4a6bd06d4935502f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:12Z,use_quota=True,user_id='fe10c008aa51499882496ceb43bf736f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f978ab8-99d3-4e3c-9b7a-d0b671bc7d96),volume_type_id=3f978ab8-99d3-4e3c-9b7a-d0b671bc7d96)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38dbc76d-a7e2-4143-8417-696e98361eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38dbc76d-a7e2-4143-8417-696e98361eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcd44cf-6ed3-4722-9acd-062aedd31df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.image.glance [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Creating Keystone auth plugin from conf {{(pid=87345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (1586a18c-67d8-4f0e-9f37-a7ee3ac57923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d039004-6c0c-4501-a880-f1dee1662a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d039004-6c0c-4501-a880-f1dee1662a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-758658638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0fc8ef-1d01-4198-9565-90b9260f4111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:12Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3f7af4-c9eb-4d32-8cdf-9c7c2b3c8d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3f7af4-c9eb-4d32-8cdf-9c7c2b3c8d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987d44e1-b030-48d3-ab6c-a34d2d14b519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987d44e1-b030-48d3-ab6c-a34d2d14b519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a0fc8ef-1d01-4198-9565-90b9260f4111', 'volume_name': 'volume-4a0fc8ef-1d01-4198-9565-90b9260f4111', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26989a07-a871-4eeb-bb49-423ae68b6e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26989a07-a871-4eeb-bb49-423ae68b6e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fd01d2-b2da-4ade-9d02-4d056bf22519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:12 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume 4a0fc8ef-1d01-4198-9565-90b9260f4111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a0fc8ef-1d01-4198-9565-90b9260f4111', 'volume_size': 1} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:12 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7 Jul 16 11:19:12 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcd44cf-6ed3-4722-9acd-062aedd31df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '18d279b0-00b9-48db-98ea-83f0c0a80958', 'volume_name': 'volume-18d279b0-00b9-48db-98ea-83f0c0a80958', 'volume_size': 1, 'image_id': '3520a41e-7afc-44e1-8d15-c785a15ca921', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3520a41e-7afc-44e1-8d15-c785a15ca921', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2c2900dbf5e28518bfe37f312e48d99', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07a18d998c8448a4a6bd06d4935502f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '803ec1a416c21b401d8dd3b3bbc0fe7d100a0ba7a670c61613d49c74157e89967123bbf4e40d8f594406d601518f0bfae559938bb2b0c2c72f005452f979bca6', 'id': '3520a41e-7afc-44e1-8d15-c785a15ca921', 'created_at': datetime.datetime(2026, 7, 16, 9, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 19, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3520a41e-7afc-44e1-8d15-c785a15ca921/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f81837b-b6cd-41a1-b6ba-ac658e299e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f81837b-b6cd-41a1-b6ba-ac658e299e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0078e937-994c-499e-be5e-82a60a72994a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:12 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Volume 18d279b0-00b9-48db-98ea-83f0c0a80958: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-18d279b0-00b9-48db-98ea-83f0c0a80958', 'volume_size': 1, 'image_id': '3520a41e-7afc-44e1-8d15-c785a15ca921', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3520a41e-7afc-44e1-8d15-c785a15ca921', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2c2900dbf5e28518bfe37f312e48d99', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07a18d998c8448a4a6bd06d4935502f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '803ec1a416c21b401d8dd3b3bbc0fe7d100a0ba7a670c61613d49c74157e89967123bbf4e40d8f594406d601518f0bfae559938bb2b0c2c72f005452f979bca6', 'id': '3520a41e-7afc-44e1-8d15-c785a15ca921', 'created_at': datetime.datetime(2026, 7, 16, 9, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 19, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3520a41e-7afc-44e1-8d15-c785a15ca921/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Trying to clone 18d279b0-00b9-48db-98ea-83f0c0a80958 from image 3520a41e-7afc-44e1-8d15-c785a15ca921 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3520a41e-7afc-44e1-8d15-c785a15ca921', 'metadata': {}}]). {{(pid=87345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 11:19:12 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.435s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-530073611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d0d826-1478-441f-bdbc-77773b57e183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac88377ecaad416aae7280612cb64a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:09Z,use_quota=True,user_id='cc46c603b08a46c5886dfd5cdf53f230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Creating volume e9d0d826-1478-441f-bdbc-77773b57e183 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:12 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 11:19:12 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Image download 0.00 MB at 0.00 MB/s Jul 16 11:19:12 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183 1073741824 Jul 16 11:19:12 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d40dff-dba1-47de-93a9-6ef1e6b272d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a14b3a-b730-4833-a987-ae757ab74dc7', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c268abb3-609f-4d5f-832b-58e43aaae345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3d5b7f-058b-42cd-a6bb-ad7406c601c7]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:12 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Volume volume-15a14b3a-b730-4833-a987-ae757ab74dc7 (15a14b3a-b730-4833-a987-ae757ab74dc7): created successfully Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c268abb3-609f-4d5f-832b-58e43aaae345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:12 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Flow 'volume_create_manager' (dbf1da1f-e5dc-41fd-bc4b-9a77547d933c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:12 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-02f3fbea-078f-4403-a767-9d9a5a9690c0 tempest-CreateVolumesFromImageTest-1179210377 None] Created volume successfully. Jul 16 11:19:12 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD Jul 16 11:19:12 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:13 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:13 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183 1073741824" returned: 0 in 0.472s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:13 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD Jul 16 11:19:13 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:13 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183 Jul 16 11:19:13 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:13 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD" returned: 1 in 0.333s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Temporary image 3520a41e-7afc-44e1-8d15-c785a15ca921 is fetched for user fe10c008aa51499882496ceb43bf736f. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 11:19:13 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.768s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1341838681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66a393b-315e-43f0-9e5c-47ff4ed6d104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac88377ecaad416aae7280612cb64a27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:10Z,use_quota=True,user_id='cc46c603b08a46c5886dfd5cdf53f230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Creating volume d66a393b-315e-43f0-9e5c-47ff4ed6d104 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:13 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (accce3a7-fe86-4aff-8c05-120e62692661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d0d826-1478-441f-bdbc-77773b57e183', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:13 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104 1073741824 Jul 16 11:19:13 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba96279-be0e-4f1e-910e-73116c24fd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:13 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Volume volume-e9d0d826-1478-441f-bdbc-77773b57e183 (e9d0d826-1478-441f-bdbc-77773b57e183): created successfully Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba96279-be0e-4f1e-910e-73116c24fd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Flow 'volume_create_manager' (ae500cd5-847e-41af-aa98-6b5e7d21ea58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8066d84-8930-4a8a-a379-5e711504c626]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:13 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-552f27c4-937a-4085-a480-04f2f4b1f9ec tempest-CreateVolumesFromImageTest-1179210377 None] Created volume successfully. Jul 16 11:19:13 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD Jul 16 11:19:13 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:13 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:13 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104 1073741824" returned: 0 in 0.426s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:13 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104 Jul 16 11:19:13 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:13 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD Jul 16 11:19:13 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:14 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104" returned: 0 in 0.280s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.811s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-684101822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5820c86-987a-4648-b9e6-3cdba9228b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:10Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Creating volume a5820c86-987a-4648-b9e6-3cdba9228b6d {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:14 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:14 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD" returned: 1 in 0.366s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53871314-3ed7-41c2-98a7-d4cc8d89546a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:14 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d 1073741824 Jul 16 11:19:14 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2d79ab-9fac-4390-a0c4-397959db020e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:14 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Volume volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104 (d66a393b-315e-43f0-9e5c-47ff4ed6d104): created successfully Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2d79ab-9fac-4390-a0c4-397959db020e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Flow 'volume_create_manager' (d187627b-3ef0-406b-9ac2-4f015766bf46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:14 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-96c45250-0a80-4ce4-b3b1-fc32b0c8b209 tempest-CreateVolumesFromImageTest-1179210377 None] Created volume successfully. Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "cinder-d66a393b-315e-43f0-9e5c-47ff4ed6d104-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-d66a393b-315e-43f0-9e5c-47ff4ed6d104-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "cinder-quobyte-d66a393b-315e-43f0-9e5c-47ff4ed6d104" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-quobyte-d66a393b-315e-43f0-9e5c-47ff4ed6d104" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[37049347-17a7-4125-a582-7c625e6d501a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:14 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104 Jul 16 11:19:14 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:14 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d 1073741824" returned: 0 in 0.454s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:14 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d Jul 16 11:19:14 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:14 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104" returned: 0 in 0.359s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:14 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104 Jul 16 11:19:14 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:14 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d" returned: 0 in 0.253s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.138s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-811218640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:11Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Creating volume eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:14 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73bdd870-95a5-4031-abe6-167df5bd77a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5820c86-987a-4648-b9e6-3cdba9228b6d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:14 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b 1073741824 Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d85ac3-b830-41a4-823c-11daf9557a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:14 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:14 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume volume-a5820c86-987a-4648-b9e6-3cdba9228b6d (a5820c86-987a-4648-b9e6-3cdba9228b6d): created successfully Jul 16 11:19:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d85ac3-b830-41a4-823c-11daf9557a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (89b10b37-42ca-4351-807e-b8d9ee9acd37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ab504f50-c67e-4200-8c2d-6dd97ae4e561 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created volume successfully. Jul 16 11:19:15 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d66a393b-315e-43f0-9e5c-47ff4ed6d104" returned: 0 in 0.266s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-quobyte-d66a393b-315e-43f0-9e5c-47ff4ed6d104" released by "delete_volume" :: held 0.661s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Created reservations ['dbd238fe-c469-44a9-b836-659260144bee', '118fe0c5-1d0a-4c5f-adc5-c2a6cda02ccd', 'ef307051-b5b6-4674-8dcf-52f1404a75fe', 'b4440134-0ae6-4878-b1a9-155f69dae08c'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:15 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:15 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:15 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b 1073741824" returned: 0 in 0.499s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:15 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b Jul 16 11:19:15 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:15 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Deleted volume successfully. Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8a9840ce-d8f1-4208-a1b2-40cd262f0c04 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-d66a393b-315e-43f0-9e5c-47ff4ed6d104-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "cinder-e9d0d826-1478-441f-bdbc-77773b57e183-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-e9d0d826-1478-441f-bdbc-77773b57e183-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "cinder-quobyte-e9d0d826-1478-441f-bdbc-77773b57e183" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-quobyte-e9d0d826-1478-441f-bdbc-77773b57e183" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbcacf5-aa6c-4cd5-9683-72eaddc89544]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:15 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b" returned: 0 in 0.262s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.500s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1604883879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c61ded5-7985-43d3-a00a-3fdab7798c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:11Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Creating volume 3c61ded5-7985-43d3-a00a-3fdab7798c74 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:15 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:15 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183 Jul 16 11:19:15 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:15 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74 1073741824 Jul 16 11:19:15 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8dc8f7-23a6-46e2-aa56-cf024e59c2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb77751-faa3-49ad-9834-6333cb042a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:15 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b (eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b): created successfully Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb77751-faa3-49ad-9834-6333cb042a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:15 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (9b3ad529-8dad-4e98-95b6-2d0c8a1666d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-a6443353-2dd7-43f2-9b33-d3b0832714f7 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created volume successfully. Jul 16 11:19:16 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183" returned: 0 in 0.364s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:16 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183 Jul 16 11:19:16 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:16 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74 1073741824" returned: 0 in 0.436s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:16 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74 Jul 16 11:19:16 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:16 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e9d0d826-1478-441f-bdbc-77773b57e183" returned: 0 in 0.294s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-quobyte-e9d0d826-1478-441f-bdbc-77773b57e183" released by "delete_volume" :: held 0.701s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Created reservations ['e2f46d23-f290-45b7-9edc-672ccc045019', '2ef958b7-f41d-4bc5-be03-9ba1dc075145', '3aa58be9-cf40-4b92-97e1-563cda3d1bed', 'fc5f99f2-b6d7-41d3-a5a0-d78a6e1b8e2f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:16 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:16 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:16 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74" returned: 0 in 0.277s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.770s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1171186213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303ea2e0-fa4f-41f2-90ac-76013c3fb1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:12Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Creating volume 303ea2e0-fa4f-41f2-90ac-76013c3fb1df {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:16 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5c3680-fe4c-4695-8364-7e5376230bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c61ded5-7985-43d3-a00a-3fdab7798c74', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f136bd19-7e26-42a6-a375-c5720fbb2914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:16 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df 1073741824 Jul 16 11:19:16 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:16 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume volume-3c61ded5-7985-43d3-a00a-3fdab7798c74 (3c61ded5-7985-43d3-a00a-3fdab7798c74): created successfully Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f136bd19-7e26-42a6-a375-c5720fbb2914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (dcd52a5c-f146-4824-b675-5f42020f6a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:16 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4da9368a-8f0a-4fd5-9082-9aec85f6fed4 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created volume successfully. Jul 16 11:19:16 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:16 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Deleted volume successfully. Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "cinder-15a14b3a-b730-4833-a987-ae757ab74dc7-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d25ece9d-5c97-4e6e-a417-be516653895c tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-e9d0d826-1478-441f-bdbc-77773b57e183-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-15a14b3a-b730-4833-a987-ae757ab74dc7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "cinder-quobyte-15a14b3a-b730-4833-a987-ae757ab74dc7" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-quobyte-15a14b3a-b730-4833-a987-ae757ab74dc7" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f775d57-e9a5-48e5-91bc-4b564db4ef28]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:16 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7 Jul 16 11:19:16 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:16 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df 1073741824" returned: 0 in 0.461s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:17 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df Jul 16 11:19:17 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:17 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7" returned: 0 in 0.368s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:17 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7 Jul 16 11:19:17 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:17 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.993s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26535494-20ac-4754-a931-ef123c848c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4aed71f-692c-433c-9e96-a80e4027d7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] Creating offline snapshot f1784838-ff9d-4b19-8aec-c90f0c32a258 of volume d2bcd125-8b61-414a-9cc9-98c8466ab158 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:19:17 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df (303ea2e0-fa4f-41f2-90ac-76013c3fb1df): created successfully Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4aed71f-692c-433c-9e96-a80e4027d7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (2627cfe1-133a-41aa-968b-d7090a5d82c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b2b3af-0770-4438-9dad-a44dccca1279]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-3cb91771-f015-4d1e-8a2a-292166917898 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created volume successfully. Jul 16 11:19:17 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 Jul 16 11:19:17 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:17 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-15a14b3a-b730-4833-a987-ae757ab74dc7" returned: 0 in 0.261s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-quobyte-15a14b3a-b730-4833-a987-ae757ab74dc7" released by "delete_volume" :: held 0.670s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Created reservations ['1c8a37a9-8ba2-4ec5-9879-1df5de247289', 'd8d52d94-7c56-4f5c-99ed-66b74f5c8975', '8b7a4b1d-49fc-4985-b0eb-0855d370923e', '35d5911e-d331-4d0d-9d64-f3feaca9ade1'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:17 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:17 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:17 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158" returned: 0 in 0.399s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:17 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 1G Jul 16 11:19:17 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:17 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Deleted volume successfully. Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "cinder-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9602b116-5575-4abb-8f3c-0474262670db tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-15a14b3a-b730-4833-a987-ae757ab74dc7-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "cinder-quobyte-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-quobyte-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d4422e-29aa-4363-8b54-1c8238be0371]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:18 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f Jul 16 11:19:18 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:18 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 1G" returned: 0 in 0.414s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:18 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 Jul 16 11:19:18 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:18 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f" returned: 0 in 0.384s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:18 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f Jul 16 11:19:18 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:18 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258" returned: 0 in 0.307s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:18 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 is being set with open permissions: ugo+rw Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:18 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 Jul 16 11:19:18 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:18 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f" returned: 0 in 0.259s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-quobyte-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f" released by "delete_volume" :: held 0.687s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:18 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258" returned: 0 in 0.256s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Created reservations ['2831b504-dd7a-4b02-8575-f65c12497d28', '7b5d5ffc-9804-4cce-ba42-7ef7cca2995d', '6da21e17-58c5-4eb2-86df-d655ee74a344', 'e6c43bd0-ae40-4956-a003-e4b99ec9fe01'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:18 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.info Jul 16 11:19:18 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:18 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:18 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:19 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.info" returned: 0 in 0.251s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:19 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.info is being set with open permissions: ugo+rw Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:19 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.info Jul 16 11:19:19 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:19 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.255s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:19 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Deleted volume successfully. Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "cinder-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-01f5d79c-09e4-4b5e-a6ec-92f7b6713e37 tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-d0b8b1bd-3699-48d8-bbe2-208c7c7e829f-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "cinder-quobyte-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-quobyte-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c6e6f-c89d-481d-b9ca-9d36a1647410]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:19 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.info" returned: 0 in 0.293s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.963s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-758658638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0fc8ef-1d01-4198-9565-90b9260f4111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb44fefada9447c9805df493e0a0722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:12Z,use_quota=True,user_id='5bc847eb5ec84fdbbc5e18db9a00ef3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Creating volume 4a0fc8ef-1d01-4198-9565-90b9260f4111 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:19 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:19 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111 1073741824 Jul 16 11:19:19 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:19 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6 Jul 16 11:19:19 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:19 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-46db0f83-d3d7-4abc-aa4b-03d5c3f2215c tempest-CreateVolumesFromSnapshotTest-499515465 None] Create snapshot completed successfully Jul 16 11:19:19 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6" returned: 0 in 0.378s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:19 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6 Jul 16 11:19:19 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:19 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111 1073741824" returned: 0 in 0.450s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:19 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111 Jul 16 11:19:19 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:19 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6" returned: 0 in 0.266s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-quobyte-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6" released by "delete_volume" :: held 0.713s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:19 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Created reservations ['3b60b2d7-0baa-498b-b207-5464bab49836', '192890d0-5a47-4bd2-b5a9-01a570b0ccfc', '995fd313-6dcc-438b-974d-76c1474d9e9c', '14e34a3e-54c4-4f72-a0bc-e6b11fef4ea0'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:20 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:20 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:20 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111" returned: 0 in 0.248s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.883s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d279b0-00b9-48db-98ea-83f0c0a80958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07a18d998c8448a4a6bd06d4935502f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:12Z,use_quota=True,user_id='fe10c008aa51499882496ceb43bf736f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f978ab8-99d3-4e3c-9b7a-d0b671bc7d96),volume_type_id=3f978ab8-99d3-4e3c-9b7a-d0b671bc7d96)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Creating volume 18d279b0-00b9-48db-98ea-83f0c0a80958 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:20 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fd01d2-b2da-4ade-9d02-4d056bf22519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a0fc8ef-1d01-4198-9565-90b9260f4111', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e8e27a-5400-4a17-bac3-72597756dca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:20 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 1073741824 Jul 16 11:19:20 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:20 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Volume volume-4a0fc8ef-1d01-4198-9565-90b9260f4111 (4a0fc8ef-1d01-4198-9565-90b9260f4111): created successfully Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e8e27a-5400-4a17-bac3-72597756dca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Flow 'volume_create_manager' (1586a18c-67d8-4f0e-9f37-a7ee3ac57923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-56014754-8721-48c5-a946-41bb41b186bf tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created volume successfully. Jul 16 11:19:20 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.288s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Deleted volume successfully. Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-53b6485f-ee1e-4cfc-8d88-a01ed33d2b3a tempest-CreateVolumesFromImageTest-1179210377 None] Lock "cinder-06d1e4f9-4263-4310-8a8e-f2b8c3bf3ed6-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:20 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 1073741824" returned: 0 in 0.527s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:20 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 Jul 16 11:19:20 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (765791e7-46ea-4ff1-b608-c5be90e570cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b44cf4-66f7-48d7-a2b3-1e591ebee9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-4a0fc8ef-1d01-4198-9565-90b9260f4111-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b44cf4-66f7-48d7-a2b3-1e591ebee9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-612147655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4556ae4-dc93-4d32-8638-c9bb8e6cc30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:21Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf22bd0-7a50-4bc1-a3cc-686a370706a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf22bd0-7a50-4bc1-a3cc-686a370706a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ff75bd-9f4f-4a78-aec0-8c45ddd167ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ff75bd-9f4f-4a78-aec0-8c45ddd167ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4556ae4-dc93-4d32-8638-c9bb8e6cc30d', 'volume_name': 'volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74995a80-a17e-443f-8549-6a58a64988b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74995a80-a17e-443f-8549-6a58a64988b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54893be0-e40f-490c-9188-df26d7b7061e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:21 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume c4556ae4-dc93-4d32-8638-c9bb8e6cc30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d', 'volume_size': 1} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-4a0fc8ef-1d01-4198-9565-90b9260f4111-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:21 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958" returned: 0 in 0.406s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-612147655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4556ae4-dc93-4d32-8638-c9bb8e6cc30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:21Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Creating volume c4556ae4-dc93-4d32-8638-c9bb8e6cc30d {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:21 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-quobyte-4a0fc8ef-1d01-4198-9565-90b9260f4111" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:21 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d 1073741824 Jul 16 11:19:21 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Attempting download of 3520a41e-7afc-44e1-8d15-c785a15ca921 ((None, [{'url': 'file:///opt/stack/data/glance/images/3520a41e-7afc-44e1-8d15-c785a15ca921', 'metadata': {}}])) to volume 18d279b0-00b9-48db-98ea-83f0c0a80958. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-4a0fc8ef-1d01-4198-9565-90b9260f4111" acquired by "delete_volume" :: waited 0.035s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c6bc67-401b-48b6-997f-2298750300d2]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0b0f17-ee10-4a9f-9943-c23b60bb7566]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3520a41e-7afc-44e1-8d15-c785a15ca921_im6kvy6f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:21 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111 Jul 16 11:19:21 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:21 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3520a41e-7afc-44e1-8d15-c785a15ca921_im6kvy6f Jul 16 11:19:21 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (12f96c04-8ba9-4d3c-9060-4d4c02822f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f2930a-5d16-48f7-8a4b-ce8f1c58e917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f2930a-5d16-48f7-8a4b-ce8f1c58e917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-441190008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270a57bb-3c9d-453e-872a-d512d746d19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:21Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380f0a4b-63a2-4c60-813b-6ad67ae9c07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380f0a4b-63a2-4c60-813b-6ad67ae9c07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6d6e92-ffd2-403b-bbba-790a0463a135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6d6e92-ffd2-403b-bbba-790a0463a135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270a57bb-3c9d-453e-872a-d512d746d19b', 'volume_name': 'volume-270a57bb-3c9d-453e-872a-d512d746d19b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a995c735-11e2-42ad-959e-ec7e7942a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a995c735-11e2-42ad-959e-ec7e7942a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82a837a-e99d-4de0-aa28-d000f71b3615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:21 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume 270a57bb-3c9d-453e-872a-d512d746d19b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270a57bb-3c9d-453e-872a-d512d746d19b', 'volume_size': 1} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:21 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111" returned: 0 in 0.565s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:21 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d 1073741824" returned: 0 in 0.748s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:21 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111 Jul 16 11:19:21 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:21 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3520a41e-7afc-44e1-8d15-c785a15ca921_im6kvy6f" returned: 0 in 0.681s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3520a41e-7afc-44e1-8d15-c785a15ca921_im6kvy6f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:21 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d Jul 16 11:19:21 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:22 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-4a0fc8ef-1d01-4198-9565-90b9260f4111" returned: 0 in 0.327s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:22 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3520a41e-7afc-44e1-8d15-c785a15ca921_im6kvy6f Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-4a0fc8ef-1d01-4198-9565-90b9260f4111" released by "delete_volume" :: held 1.001s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:22 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (5e2a961e-7986-4b76-9361-91c9e6618bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2ac34e-eace-4686-8f4c-0df30deefc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created reservations ['013e809b-16eb-466b-a38a-f8cff1c2e633', 'ca8471a3-c3d5-4004-b086-9bfecbe4bb48', 'eb7b312a-42b5-4caf-88d7-65273c7d4ab6', '1c23a2d0-702a-4f75-bd3b-b805ba6229d9'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:22 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2ac34e-eace-4686-8f4c-0df30deefc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548284066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff67aadc-a091-4b9e-812c-2502e00d276e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:22Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:22 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcef4136-a7d9-49cc-bbe4-104a2ddeeb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcef4136-a7d9-49cc-bbe4-104a2ddeeb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c7acda-e2be-4ded-b000-4f736e82a357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c7acda-e2be-4ded-b000-4f736e82a357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff67aadc-a091-4b9e-812c-2502e00d276e', 'volume_name': 'volume-ff67aadc-a091-4b9e-812c-2502e00d276e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e87193-ad9c-4a97-aea0-efc98175cf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e87193-ad9c-4a97-aea0-efc98175cf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff3e991-4e91-4d18-a908-8f1f6a6f2387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:22 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume ff67aadc-a091-4b9e-812c-2502e00d276e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff67aadc-a091-4b9e-812c-2502e00d276e', 'volume_size': 1} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3520a41e-7afc-44e1-8d15-c785a15ca921_im6kvy6f" returned: 1 in 0.565s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3520a41e-7afc-44e1-8d15-c785a15ca921_im6kvy6f' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d" returned: 0 in 0.589s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa0b6e3-ea7f-448f-90df-0340bb990efd]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.873s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-441190008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270a57bb-3c9d-453e-872a-d512d746d19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:21Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Creating volume 270a57bb-3c9d-453e-872a-d512d746d19b {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:22 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:22 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b 1073741824 Jul 16 11:19:22 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54893be0-e40f-490c-9188-df26d7b7061e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3789d1-de70-416d-a302-0293c872ba8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:22 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d (c4556ae4-dc93-4d32-8638-c9bb8e6cc30d): created successfully Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3789d1-de70-416d-a302-0293c872ba8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (765791e7-46ea-4ff1-b608-c5be90e570cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:22 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD Jul 16 11:19:22 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:22 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8fec39a4-60ea-438c-b05d-02fd56f423c2 tempest-CreateVolumesFromSnapshotTest-499515465 None] Created volume successfully. Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:22 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:22 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (194e6213-bb5f-4dd9-83ed-50e63a7a948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078cac9c-30de-47dd-ac1f-b11f3380e5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078cac9c-30de-47dd-ac1f-b11f3380e5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-925610565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211b4a73-33bf-40bb-a1b3-a17e4b22d8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:23Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6d9964-252e-4c91-932d-763de52d8bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6d9964-252e-4c91-932d-763de52d8bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb9d9e5-84b5-45f8-ad8d-e64f8a1f25e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb9d9e5-84b5-45f8-ad8d-e64f8a1f25e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211b4a73-33bf-40bb-a1b3-a17e4b22d8cc', 'volume_name': 'volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299611ba-c7e1-4a3a-807c-c4a480f823d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299611ba-c7e1-4a3a-807c-c4a480f823d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f18e70c-5d8a-4b57-bef9-997485d65a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:23 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume 211b4a73-33bf-40bb-a1b3-a17e4b22d8cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc', 'volume_size': 1} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:23 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:23 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.429s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:23 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Deleted volume successfully. Jul 16 11:19:23 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD Jul 16 11:19:23 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-94361adf-13ca-45a0-865b-a272a225a1fa tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-4a0fc8ef-1d01-4198-9565-90b9260f4111-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-303ea2e0-fa4f-41f2-90ac-76013c3fb1df-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:23 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-303ea2e0-fa4f-41f2-90ac-76013c3fb1df-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b 1073741824" returned: 0 in 0.906s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (93b54862-9c2a-4727-b67f-d60e9656479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792932e7-d3a8-41cb-a805-81e2fa9959b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-quobyte-303ea2e0-fa4f-41f2-90ac-76013c3fb1df" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792932e7-d3a8-41cb-a805-81e2fa9959b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-351166333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e93f8f-1fcb-4757-b2d2-93ec1ab7392a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:23Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a9329f-2d28-4185-9c82-a49b057f0d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a9329f-2d28-4185-9c82-a49b057f0d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4e1519-cce4-4892-b76f-6e5e5de94d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4e1519-cce4-4892-b76f-6e5e5de94d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e93f8f-1fcb-4757-b2d2-93ec1ab7392a', 'volume_name': 'volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14eef866-7ff1-4b1c-a517-fe7a95b3bb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14eef866-7ff1-4b1c-a517-fe7a95b3bb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57e9fd8-cf46-4306-96d6-a4cb3a312602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:23 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume 39e93f8f-1fcb-4757-b2d2-93ec1ab7392a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a', 'volume_size': 1} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:23 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD" returned: 1 in 0.508s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] 3520a41e-7afc-44e1-8d15-c785a15ca921 was raw, converting to qcow2 {{(pid=87345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:23 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b Jul 16 11:19:23 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-303ea2e0-fa4f-41f2-90ac-76013c3fb1df" acquired by "delete_volume" :: waited 0.090s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:23 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 Jul 16 11:19:23 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c0f040-c5cc-4e6e-becb-e551a2417cde]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:23 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df Jul 16 11:19:23 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:23 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b" returned: 0 in 0.304s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.392s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548284066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff67aadc-a091-4b9e-812c-2502e00d276e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:22Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Creating volume ff67aadc-a091-4b9e-812c-2502e00d276e {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:23 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82a837a-e99d-4de0-aa28-d000f71b3615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270a57bb-3c9d-453e-872a-d512d746d19b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a301ad00-b533-4c27-ac0b-7bc70db4962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:23 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e 1073741824 Jul 16 11:19:23 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:23 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume volume-270a57bb-3c9d-453e-872a-d512d746d19b (270a57bb-3c9d-453e-872a-d512d746d19b): created successfully Jul 16 11:19:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a301ad00-b533-4c27-ac0b-7bc70db4962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (12f96c04-8ba9-4d3c-9060-4d4c02822f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:24 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d1e15f86-533c-4bd1-90d6-bca5e03f2343 tempest-CreateVolumesFromSnapshotTest-499515465 None] Created volume successfully. Jul 16 11:19:24 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df" returned: 0 in 0.480s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:24 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df Jul 16 11:19:24 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:24 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958" returned: 0 in 0.630s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3520a41e-7afc-44e1-8d15-c785a15ca921_nmdmi923devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:19:24 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:24 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 1G Jul 16 11:19:24 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:24 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-303ea2e0-fa4f-41f2-90ac-76013c3fb1df" returned: 0 in 0.328s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:24 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e 1073741824" returned: 0 in 0.593s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-303ea2e0-fa4f-41f2-90ac-76013c3fb1df" released by "delete_volume" :: held 0.886s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created reservations ['e0d1d339-ef5c-42e3-b29e-bc145d5ae434', '79830cec-c75a-4517-8804-df8dc3b54eb0', '085b96e5-50e6-4790-9473-d3e8e6700acb', '8ece3d7f-fd2f-4af2-afc8-9864085d9d5d'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:24 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e Jul 16 11:19:24 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:24 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 1G" returned: 0 in 0.420s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Downloaded image 3520a41e-7afc-44e1-8d15-c785a15ca921 ((None, [{'url': 'file:///opt/stack/data/glance/images/3520a41e-7afc-44e1-8d15-c785a15ca921', 'metadata': {}}])) to volume 18d279b0-00b9-48db-98ea-83f0c0a80958 successfully. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Temporary image 3520a41e-7afc-44e1-8d15-c785a15ca921 for user fe10c008aa51499882496ceb43bf736f is deleted. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Marking volume 18d279b0-00b9-48db-98ea-83f0c0a80958 as bootable. {{(pid=87345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Copying metadata from image 3520a41e-7afc-44e1-8d15-c785a15ca921 to 18d279b0-00b9-48db-98ea-83f0c0a80958. {{(pid=87345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Creating volume glance metadata for volume 18d279b0-00b9-48db-98ea-83f0c0a80958 backed by image 3520a41e-7afc-44e1-8d15-c785a15ca921 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3520a41e-7afc-44e1-8d15-c785a15ca921', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a2c2900dbf5e28518bfe37f312e48d99', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:24 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:24 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0078e937-994c-499e-be5e-82a60a72994a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d279b0-00b9-48db-98ea-83f0c0a80958', 'volume_size': 1, 'image_id': '3520a41e-7afc-44e1-8d15-c785a15ca921', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3520a41e-7afc-44e1-8d15-c785a15ca921', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2c2900dbf5e28518bfe37f312e48d99', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07a18d998c8448a4a6bd06d4935502f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '803ec1a416c21b401d8dd3b3bbc0fe7d100a0ba7a670c61613d49c74157e89967123bbf4e40d8f594406d601518f0bfae559938bb2b0c2c72f005452f979bca6', 'id': '3520a41e-7afc-44e1-8d15-c785a15ca921', 'created_at': datetime.datetime(2026, 7, 16, 9, 19, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 19, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3520a41e-7afc-44e1-8d15-c785a15ca921/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2336de8b-4358-4b5f-ac26-1bc2b9aa49a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:24 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Volume volume-18d279b0-00b9-48db-98ea-83f0c0a80958 (18d279b0-00b9-48db-98ea-83f0c0a80958): created successfully Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2336de8b-4358-4b5f-ac26-1bc2b9aa49a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Flow 'volume_create_manager' (278f7817-5b3a-4081-9929-4f341802478e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:24 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b8ad5984-e43d-4f8d-8b94-254df87a2236 tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Created volume successfully. Jul 16 11:19:24 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e" returned: 0 in 0.305s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-925610565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211b4a73-33bf-40bb-a1b3-a17e4b22d8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:23Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Creating volume 211b4a73-33bf-40bb-a1b3-a17e4b22d8cc {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:24 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:24 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc 1073741824 Jul 16 11:19:24 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff3e991-4e91-4d18-a908-8f1f6a6f2387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff67aadc-a091-4b9e-812c-2502e00d276e', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b42489-f9e9-4c81-a538-ff5e11bbde15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:24 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume volume-ff67aadc-a091-4b9e-812c-2502e00d276e (ff67aadc-a091-4b9e-812c-2502e00d276e): created successfully Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b42489-f9e9-4c81-a538-ff5e11bbde15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:24 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (5e2a961e-7986-4b76-9361-91c9e6618bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:25 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.285s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:25 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Deleted volume successfully. Jul 16 11:19:25 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-95e50f57-717a-4625-8ca5-9571e9ab2945 tempest-CreateVolumesFromSnapshotTest-499515465 None] Created volume successfully. Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-08c9904d-62e5-4cd4-9a21-37e82969fd35 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-303ea2e0-fa4f-41f2-90ac-76013c3fb1df-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Acquiring lock "cinder-18d279b0-00b9-48db-98ea-83f0c0a80958-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Lock "cinder-18d279b0-00b9-48db-98ea-83f0c0a80958-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Acquiring lock "cinder-quobyte-18d279b0-00b9-48db-98ea-83f0c0a80958" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Lock "cinder-quobyte-18d279b0-00b9-48db-98ea-83f0c0a80958" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee14b88-3864-485f-a7e2-699f2936365f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:25 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 Jul 16 11:19:25 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:25 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc 1073741824" returned: 0 in 0.537s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:25 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc Jul 16 11:19:25 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:25 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958" returned: 0 in 0.437s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:25 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958 Jul 16 11:19:25 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-3c61ded5-7985-43d3-a00a-3fdab7798c74-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-3c61ded5-7985-43d3-a00a-3fdab7798c74-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:25 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc" returned: 0 in 0.297s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.193s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-351166333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e93f8f-1fcb-4757-b2d2-93ec1ab7392a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c8662bded240d8babfc9509e1867fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:23Z,use_quota=True,user_id='d662012f029f41afaec9a11d19b9a039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Creating volume 39e93f8f-1fcb-4757-b2d2-93ec1ab7392a {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:25 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f18e70c-5d8a-4b57-bef9-997485d65a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:25 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a 1073741824 Jul 16 11:19:25 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380ac2b1-a3cb-4949-8496-a87bc372e0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-quobyte-3c61ded5-7985-43d3-a00a-3fdab7798c74" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:25 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc (211b4a73-33bf-40bb-a1b3-a17e4b22d8cc): created successfully Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380ac2b1-a3cb-4949-8496-a87bc372e0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (194e6213-bb5f-4dd9-83ed-50e63a7a948c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-3c61ded5-7985-43d3-a00a-3fdab7798c74" acquired by "delete_volume" :: waited 0.049s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:25 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7246e476-a1a5-4ab7-8281-6a4745961ee6 tempest-CreateVolumesFromSnapshotTest-499515465 None] Created volume successfully. Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fd63af-4620-4c6a-a60f-df2c8a353459]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:25 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-18d279b0-00b9-48db-98ea-83f0c0a80958" returned: 0 in 0.349s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Lock "cinder-quobyte-18d279b0-00b9-48db-98ea-83f0c0a80958" released by "delete_volume" :: held 0.833s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Created reservations ['a82de38f-a9c3-42ce-93a2-e6cb930a37f8', '3ab62800-ce9b-4233-b590-4b1c5b150e98', '75272326-9d6c-48ab-a943-cd2d77d32aaf', '52595833-e2c2-446a-938a-8367bb99fbc2'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:26 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74 Jul 16 11:19:26 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:26 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:26 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:26 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a 1073741824" returned: 0 in 0.609s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:26 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74" returned: 0 in 0.490s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:26 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74 Jul 16 11:19:26 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:26 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.351s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:26 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a Jul 16 11:19:26 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Deleted volume successfully. Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b966e27-be41-481d-aaea-fb379fdad97a tempest-VolumeAndVolumeTypeFromImageTest-757874926 None] Lock "cinder-18d279b0-00b9-48db-98ea-83f0c0a80958-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:26 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a" returned: 0 in 0.337s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57e9fd8-cf46-4306-96d6-a4cb3a312602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc0b212-b201-4248-a2b0-0d1b368961a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:26 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-3c61ded5-7985-43d3-a00a-3fdab7798c74" returned: 0 in 0.439s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-3c61ded5-7985-43d3-a00a-3fdab7798c74" released by "delete_volume" :: held 0.982s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:26 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Volume volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a (39e93f8f-1fcb-4757-b2d2-93ec1ab7392a): created successfully Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc0b212-b201-4248-a2b0-0d1b368961a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Flow 'volume_create_manager' (93b54862-9c2a-4727-b67f-d60e9656479a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-eec453c6-e2a6-4a66-8f3c-e9a361664737 tempest-CreateVolumesFromSnapshotTest-499515465 None] Created volume successfully. Jul 16 11:19:26 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created reservations ['dfc719b6-e682-47d9-aaad-8ab68769b414', 'da36efb1-2a79-4963-8fd6-af3a19bdd150', 'af1be679-fe08-47bc-ad6c-ee1aa1410014', '3a3c384c-d068-468a-ac15-5a3acd82d6e2'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:27 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:27 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:27 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.262s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:27 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:27 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Deleted volume successfully. Jul 16 11:19:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5d221c5f-b9cc-4f83-9715-0499da1c11ff tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-3c61ded5-7985-43d3-a00a-3fdab7798c74-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:27 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-quobyte-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-quobyte-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a" acquired by "delete_volume" :: waited 0.032s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b" acquired by "delete_volume" :: waited 0.035s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdb223f-a071-48a9-a342-6ccfa2096242]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c09770-0ad5-42f2-8ae4-ed22cb61a1f4]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:28 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a Jul 16 11:19:28 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:28 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b Jul 16 11:19:28 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:28 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a" returned: 0 in 0.453s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:28 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b" returned: 0 in 0.464s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:28 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a Jul 16 11:19:28 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:28 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b Jul 16 11:19:28 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:28 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a" returned: 0 in 0.302s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a" released by "delete_volume" :: held 0.825s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:28 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b" returned: 0 in 0.304s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b" released by "delete_volume" :: held 0.832s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Created reservations ['0ef6b75e-93dc-4829-b261-35b23c7da355', '6f53577e-1648-438e-a0b9-6d0a92790503', 'f8068fc7-1cde-4ea2-a92f-698c68cb27af', '130305fd-1ce1-4fee-ac56-59cdabb78b9c'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created reservations ['3833660d-d53d-4df3-ac29-0f428add8802', '6bda3230-242f-4a3e-9920-6277784a6021', '9d24f077-e9b4-47e2-b27a-2126d386f91e', '87d20cba-1f4a-42e2-81aa-c34468ab1fa5'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:29 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:29 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:29 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:29 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:29 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.318s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:29 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Deleted volume successfully. Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6c8b20ce-f441-470f-b28e-602f5e6d977d tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-39e93f8f-1fcb-4757-b2d2-93ec1ab7392a-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:29 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:29 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Deleted volume successfully. Jul 16 11:19:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-7ac5310b-0198-4841-bd78-53cfa10c0e08 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-eb6d6b25-4c8f-4f45-b5cb-6590ceb46b5b-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-a5820c86-987a-4648-b9e6-3cdba9228b6d-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-a5820c86-987a-4648-b9e6-3cdba9228b6d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-quobyte-a5820c86-987a-4648-b9e6-3cdba9228b6d" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-a5820c86-987a-4648-b9e6-3cdba9228b6d" acquired by "delete_volume" :: waited 0.034s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-quobyte-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8491cd5-aa02-4187-988d-28ea372a8857]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e1c860-0d85-4b88-a8f4-75d48aba9f94]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:30 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d Jul 16 11:19:30 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:30 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc Jul 16 11:19:30 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:30 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d" returned: 0 in 0.426s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:30 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d Jul 16 11:19:30 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:30 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc" returned: 0 in 0.475s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:31 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc Jul 16 11:19:31 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:31 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-a5820c86-987a-4648-b9e6-3cdba9228b6d" returned: 0 in 0.300s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-a5820c86-987a-4648-b9e6-3cdba9228b6d" released by "delete_volume" :: held 0.813s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:31 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc" returned: 0 in 0.299s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc" released by "delete_volume" :: held 0.825s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created reservations ['fc3c50ca-041e-44fc-8bf7-452a0384784d', '54146fd4-c268-4367-b128-034c46d7c34f', 'b2732354-14d8-433e-9449-1a93849e7b6a', 'eab5ec2a-75d2-4763-a463-73fd53b15918'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Created reservations ['9bb70527-a3b6-42e5-b248-4757fd8f6dbc', '68be7bb8-ee64-4942-959d-ce87c5224afa', '182fc6f8-862e-4ba7-9f32-0cfb6a4f0f29', '4cfc9f65-99ba-4946-9940-707027c8d745'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:31 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:31 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-ea7b9f87-be60-49bf-bdba-e21afb4487cf-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-ea7b9f87-be60-49bf-bdba-e21afb4487cf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:31 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:31 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "cinder-quobyte-ea7b9f87-be60-49bf-bdba-e21afb4487cf" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-ea7b9f87-be60-49bf-bdba-e21afb4487cf" acquired by "delete_volume" :: waited 0.035s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-ff67aadc-a091-4b9e-812c-2502e00d276e-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aa1b5f-93d1-4016-8e10-f417d0c8d6c5]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-ff67aadc-a091-4b9e-812c-2502e00d276e-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:31 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.453s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:31 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf Jul 16 11:19:31 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:31 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Deleted volume successfully. Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-quobyte-ff67aadc-a091-4b9e-812c-2502e00d276e" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2765de93-9e77-4d86-abbd-f1c75874d311 tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-a5820c86-987a-4648-b9e6-3cdba9228b6d-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-ff67aadc-a091-4b9e-812c-2502e00d276e" acquired by "delete_volume" :: waited 0.035s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:31 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.491s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:31 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:32 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Deleted volume successfully. Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[def21921-a70c-49f8-845b-d99b8b87221a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9e98f67c-384a-4473-816a-72c509092042 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-211b4a73-33bf-40bb-a1b3-a17e4b22d8cc-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Flow 'volume_create_manager' (fa548b7e-0a70-45c2-bb3a-bb54bee57d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef097dcb-9903-4cbd-a6c6-f6fc1fe1d3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef097dcb-9903-4cbd-a6c6-f6fc1fe1d3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2009956133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6f1329-3821-4d96-b18a-4397c2809f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf8f35c813846f3a8404ba3e50c08f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:32Z,use_quota=True,user_id='b2dee52023cd425081b93829386c7853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4deeb8e-7dda-45da-9c05-8ce85755457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4deeb8e-7dda-45da-9c05-8ce85755457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e35dd3-fc34-4e66-b142-f9345fb96f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e35dd3-fc34-4e66-b142-f9345fb96f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc6f1329-3821-4d96-b18a-4397c2809f74', 'volume_name': 'volume-cc6f1329-3821-4d96-b18a-4397c2809f74', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8fac3d-74ff-4ab1-acc9-3032cf545a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:32 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8fac3d-74ff-4ab1-acc9-3032cf545a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:32 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c95aef-a74b-4064-a0ea-9f672eab890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:32 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Volume cc6f1329-3821-4d96-b18a-4397c2809f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc6f1329-3821-4d96-b18a-4397c2809f74', 'volume_size': 1} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2009956133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc6f1329-3821-4d96-b18a-4397c2809f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf8f35c813846f3a8404ba3e50c08f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:32Z,use_quota=True,user_id='b2dee52023cd425081b93829386c7853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Creating volume cc6f1329-3821-4d96-b18a-4397c2809f74 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:32 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:32 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 1073741824 Jul 16 11:19:32 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:32 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf" returned: 0 in 0.499s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:32 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf Jul 16 11:19:32 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:32 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e" returned: 0 in 0.454s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:32 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e Jul 16 11:19:32 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:32 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ea7b9f87-be60-49bf-bdba-e21afb4487cf" returned: 0 in 0.290s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-quobyte-ea7b9f87-be60-49bf-bdba-e21afb4487cf" released by "delete_volume" :: held 0.878s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Created reservations ['81c9738d-1317-43e8-864b-dfe11c629bb8', '517224a7-db47-4c16-8eea-da2f41efc248', '160097f0-0419-4da9-b62c-a226a6cc8bf2', 'f5afb11e-4fb8-4361-b462-31693a2eee8a'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:32 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 1073741824" returned: 0 in 0.562s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:32 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ff67aadc-a091-4b9e-812c-2502e00d276e" returned: 0 in 0.349s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:32 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:32 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-ff67aadc-a091-4b9e-812c-2502e00d276e" released by "delete_volume" :: held 0.884s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:32 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 Jul 16 11:19:32 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:32 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Created reservations ['dec378cd-9015-4e88-9312-6a1b9b5d6eef', 'd741447c-703e-4c95-887b-dc4c9df98ea8', '10bea05c-54fe-4a95-8340-4c1df34c7abc', '1fdc23c1-a640-4235-82ee-0215b037db0f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:33 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.304s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:33 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Deleted volume successfully. Jul 16 11:19:33 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:33 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-995e0975-1f25-4da8-823d-13be55dcd90f tempest-CreateVolumesFromSourceVolumeTest-290584360 None] Lock "cinder-ea7b9f87-be60-49bf-bdba-e21afb4487cf-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:33 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74" returned: 0 in 0.327s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c95aef-a74b-4064-a0ea-9f672eab890f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc6f1329-3821-4d96-b18a-4397c2809f74', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3c2be6-b8af-4274-9ebf-2959a9f281f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:33 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Volume volume-cc6f1329-3821-4d96-b18a-4397c2809f74 (cc6f1329-3821-4d96-b18a-4397c2809f74): created successfully Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3c2be6-b8af-4274-9ebf-2959a9f281f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Flow 'volume_create_manager' (fa548b7e-0a70-45c2-bb3a-bb54bee57d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:33 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-210e8b4f-342d-4269-b359-d064729189ac tempest-VolumeDependencyTests-475878698 None] Created volume successfully. Jul 16 11:19:33 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.292s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:33 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Deleted volume successfully. Jul 16 11:19:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b03cd4e4-ad16-4c22-b8c6-024c3371a8ee tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-ff67aadc-a091-4b9e-812c-2502e00d276e-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-270a57bb-3c9d-453e-872a-d512d746d19b-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-270a57bb-3c9d-453e-872a-d512d746d19b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-quobyte-270a57bb-3c9d-453e-872a-d512d746d19b" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-270a57bb-3c9d-453e-872a-d512d746d19b" acquired by "delete_volume" :: waited 0.033s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[394f053b-6155-4764-a435-c73e91ed815d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] Creating offline snapshot 748c0e01-89fe-4ba7-942b-250d3f68335f of volume cc6f1329-3821-4d96-b18a-4397c2809f74 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca5f815-5982-42dd-b217-acde21732ac9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:34 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b Jul 16 11:19:34 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:34 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 Jul 16 11:19:34 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:34 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:34 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:34 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b" returned: 0 in 0.436s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:34 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b Jul 16 11:19:34 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:34 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74" returned: 0 in 0.504s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:35 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f 1G Jul 16 11:19:35 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:35 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.395s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:19:35 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-270a57bb-3c9d-453e-872a-d512d746d19b" returned: 0 in 0.415s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-270a57bb-3c9d-453e-872a-d512d746d19b" released by "delete_volume" :: held 0.915s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Created reservations ['871b77e9-95eb-4652-ab5f-70e0d4b9527f', '9f14e7dc-ce03-4340-98a7-58277c242fc8', '497f5b9c-0b46-42ac-b738-6d5ca3b84755', '1897f9a9-dcd9-45fe-b1fe-5c9607598d34'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:35 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:35 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:35 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f 1G" returned: 0 in 0.618s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6f1329-3821-4d96-b18a-4397c2809f74 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:35 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6f1329-3821-4d96-b18a-4397c2809f74 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f Jul 16 11:19:35 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:35 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.308s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Deleted volume successfully. Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d55489fa-ca2b-4eac-8146-38128d5be678 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-270a57bb-3c9d-453e-872a-d512d746d19b-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:35 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc6f1329-3821-4d96-b18a-4397c2809f74 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f" returned: 0 in 0.359s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:35 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f is being set with open permissions: ugo+rw Jul 16 11:19:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:35 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f Jul 16 11:19:35 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:36 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f" returned: 0 in 0.248s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:36 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.info Jul 16 11:19:36 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-quobyte-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:36 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.info" returned: 0 in 0.370s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:36 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.info is being set with open permissions: ugo+rw Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36c43c9-ccb4-4de4-b9f6-51e9f7a6ade2]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:36 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.info Jul 16 11:19:36 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:36 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d Jul 16 11:19:36 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:36 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.info" returned: 0 in 0.288s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.497s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:36 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-94d73579-e075-49f7-af32-6796eb45976d tempest-VolumeDependencyTests-475878698 None] Create snapshot completed successfully Jul 16 11:19:36 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (c368616f-20c8-465b-b5e6-fc1c123c311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521aa3db-34e2-4532-a3bf-8de27a802c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521aa3db-34e2-4532-a3bf-8de27a802c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1157968238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffc0a61-4d99-48e9-aaa7-b087f62e7240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:37Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bc34d4-5f6c-4f7e-89d9-fb757b8d1b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:37 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bc34d4-5f6c-4f7e-89d9-fb757b8d1b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc622fb-f5a5-4a9f-b34f-63ba8a33f9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bc622fb-f5a5-4a9f-b34f-63ba8a33f9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ffc0a61-4d99-48e9-aaa7-b087f62e7240', 'volume_name': 'volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61d7104-a319-4dd1-b3f3-e1552f8bdcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61d7104-a319-4dd1-b3f3-e1552f8bdcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a00f4b-de8a-4b3e-b88b-a615191deab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:37 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Volume 7ffc0a61-4d99-48e9-aaa7-b087f62e7240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240', 'volume_size': 1} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1157968238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffc0a61-4d99-48e9-aaa7-b087f62e7240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:37Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Creating volume 7ffc0a61-4d99-48e9-aaa7-b087f62e7240 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:37 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d" returned: 0 in 0.455s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:37 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 1073741824 Jul 16 11:19:37 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:37 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d Jul 16 11:19:37 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:37 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d" returned: 0 in 0.272s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d" released by "delete_volume" :: held 0.804s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Created reservations ['c744d10a-601d-4ee4-a848-fb25469378a1', '461c7495-2c6a-4eca-ac68-1a58ef2755ef', 'ce4ab080-ec28-4283-ab3a-f4b5eca04fc9', '54f4e730-5a14-4e64-bc1b-218246fedc4f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:37 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:37 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:37 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 1073741824" returned: 0 in 0.483s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:37 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 Jul 16 11:19:37 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:37 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.347s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:37 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Deleted volume successfully. Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4266e0e1-0ec8-40af-910e-ae03ae4581b0 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-c4556ae4-dc93-4d32-8638-c9bb8e6cc30d-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-f1784838-ff9d-4b19-8aec-c90f0c32a258-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-f1784838-ff9d-4b19-8aec-c90f0c32a258-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-quobyte-d2bcd125-8b61-414a-9cc9-98c8466ab158" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:37 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-d2bcd125-8b61-414a-9cc9-98c8466ab158" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-quobyte-f1784838-ff9d-4b19-8aec-c90f0c32a258" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240" returned: 0 in 0.362s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a00f4b-de8a-4b3e-b88b-a615191deab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65567f7c-d863-44ff-bfd7-2b66bf708cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-f1784838-ff9d-4b19-8aec-c90f0c32a258" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Deleting offline snapshot f1784838-ff9d-4b19-8aec-c90f0c32a258 of volume d2bcd125-8b61-414a-9cc9-98c8466ab158 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] snapshot_file for this snap is: volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:19:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Volume volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 (7ffc0a61-4d99-48e9-aaa7-b087f62e7240): created successfully Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65567f7c-d863-44ff-bfd7-2b66bf708cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (c368616f-20c8-465b-b5e6-fc1c123c311b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b7ed8-877b-49eb-a59b-28d42cb89a3f]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ccf016bd-fce9-455d-9445-6cad81f49377 tempest-ProjectMemberTests-1725097689 None] Created volume successfully. Jul 16 11:19:38 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 Jul 16 11:19:38 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Flow 'volume_create_manager' (4e07aace-abc5-459c-affa-fbc987c01ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406e4704-34b3-4856-87b4-c579f5aa7ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406e4704-34b3-4856-87b4-c579f5aa7ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-57315186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5541fb7-f6c4-4d0b-8519-27bc5d4cb426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bf8f35c813846f3a8404ba3e50c08f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=748c0e01-89fe-4ba7-942b-250d3f68335f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:38Z,use_quota=True,user_id='b2dee52023cd425081b93829386c7853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e378fedd-1da5-4338-b4da-396b86fd733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e378fedd-1da5-4338-b4da-396b86fd733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830626eb-5186-4d87-b7ab-d21bd19ba1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830626eb-5186-4d87-b7ab-d21bd19ba1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd5541fb7-f6c4-4d0b-8519-27bc5d4cb426', 'volume_name': 'volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426', 'volume_size': 1, 'snapshot_id': '748c0e01-89fe-4ba7-942b-250d3f68335f'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb5e0de-57d4-4c24-9cb5-ee07bf79e1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb5e0de-57d4-4c24-9cb5-ee07bf79e1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad96f26f-265e-4d0b-a467-8f62dc3f95f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Volume d5541fb7-f6c4-4d0b-8519-27bc5d4cb426: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426', 'volume_size': 1, 'snapshot_id': '748c0e01-89fe-4ba7-942b-250d3f68335f'} Jul 16 11:19:38 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258" returned: 0 in 0.365s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2bcd125-8b61-414a-9cc9-98c8466ab158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Acquiring lock "cinder-quobyte-748c0e01-89fe-4ba7-942b-250d3f68335f-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" by "_create_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[94063751-dcfe-4d4a-ae53-8d56e18c60b9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-748c0e01-89fe-4ba7-942b-250d3f68335f-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Creating volume d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 from snapshot 748c0e01-89fe-4ba7-942b-250d3f68335f {{(pid=87345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Acquiring lock "cinder-quobyte-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] snapshot: 748c0e01-89fe-4ba7-942b-250d3f68335f, volume: d5541fb7-f6c4-4d0b-8519-27bc5d4cb426, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d900162-9ae5-42f9-8aec-242341207790]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:38 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 Jul 16 11:19:38 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:38 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f Jul 16 11:19:38 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:38 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158" returned: 0 in 0.385s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:38 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 Jul 16 11:19:38 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:38 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f" returned: 0 in 0.390s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc6f1329-3821-4d96-b18a-4397c2809f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9be462-0bd5-41cb-9e78-d3ee0ccf47db]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:39 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 Jul 16 11:19:39 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:39 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258" returned: 0 in 0.442s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:39 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258 Jul 16 11:19:39 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:39 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74" returned: 0 in 0.502s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:39 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:19:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:39 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 Jul 16 11:19:39 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:39 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158.f1784838-ff9d-4b19-8aec-c90f0c32a258" returned: 0 in 0.315s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-f1784838-ff9d-4b19-8aec-c90f0c32a258" released by "_delete_snapshot" :: held 1.638s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-d2bcd125-8b61-414a-9cc9-98c8466ab158" released by "delete_snapshot" :: held 1.704s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:39 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Created reservations ['0ffbb82f-a4bc-4cf2-9ad3-fd7813e868ad', '077ed710-5c3f-4a00-9c9f-034ac576a5bc', '9d26ce7d-85eb-4d0e-8846-9b9c1b907352', '4e45494d-7970-4ab5-a7f9-2d24fe2f497f'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:39 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Delete snapshot completed successfully. Jul 16 11:19:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6e51c29d-b61f-40d0-81cd-655e5355f9ec tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-f1784838-ff9d-4b19-8aec-c90f0c32a258-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-d2bcd125-8b61-414a-9cc9-98c8466ab158-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-d2bcd125-8b61-414a-9cc9-98c8466ab158-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "cinder-quobyte-d2bcd125-8b61-414a-9cc9-98c8466ab158" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-d2bcd125-8b61-414a-9cc9-98c8466ab158" acquired by "delete_volume" :: waited 0.038s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:40 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a30c1b-437b-4d9c-abf4-d5ec5fb5cbda]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:41 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 Jul 16 11:19:41 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:41 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158" returned: 0 in 1.038s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:41 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158 Jul 16 11:19:41 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:42 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d2bcd125-8b61-414a-9cc9-98c8466ab158" returned: 0 in 0.511s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-quobyte-d2bcd125-8b61-414a-9cc9-98c8466ab158" released by "delete_volume" :: held 1.717s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:42 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Created reservations ['3d983ca8-deb0-4831-807d-30a229c4ab0f', 'a8ae50d5-548d-45a2-85c7-4ae493ecd0a7', '49d931e3-e416-4b42-abdb-b99111d3f3c9', 'a9e8ee8e-4329-4996-9b37-19b8b5122316'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:42 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:42 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:42 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:43 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.702s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:43 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:43 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Deleted volume successfully. Jul 16 11:19:43 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-868e9b3e-c50c-4dae-88f9-30087d85b440 tempest-CreateVolumesFromSnapshotTest-499515465 None] Lock "cinder-d2bcd125-8b61-414a-9cc9-98c8466ab158-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:44 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" returned: 0 in 5.458s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:44 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb212780-704c-4c11-8dba-6793e17e8205]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:45 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 Jul 16 11:19:45 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:45 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74" returned: 0 in 0.612s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:19:45 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Converted 1024.00 MB image at 187.53 MB/s Jul 16 11:19:45 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 is being set with open permissions: ugo+rw Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:45 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 Jul 16 11:19:45 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:45 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" returned: 0 in 0.302s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" released by "_copy_volume_from_snapshot" :: held 7.370s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-748c0e01-89fe-4ba7-942b-250d3f68335f-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" released by "_create_volume_from_snapshot" :: held 7.405s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.432s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.275s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] Creating offline snapshot 0acce89c-8f2d-4a97-8a3e-6865412b3c43 of volume 7ffc0a61-4d99-48e9-aaa7-b087f62e7240 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad96f26f-265e-4d0b-a467-8f62dc3f95f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426', 'volume_size': 1, 'snapshot_id': '748c0e01-89fe-4ba7-942b-250d3f68335f'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d03533f-607e-439c-93ae-40793a377f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39f410e-f4d0-4166-a315-7b3c82f9f72e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:45 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Volume volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 (d5541fb7-f6c4-4d0b-8519-27bc5d4cb426): created successfully Jul 16 11:19:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d03533f-607e-439c-93ae-40793a377f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Flow 'volume_create_manager' (4e07aace-abc5-459c-affa-fbc987c01ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:46 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9faa59cc-98c7-4cce-837c-158072a5be37 tempest-VolumeDependencyTests-475878698 None] Created volume successfully. Jul 16 11:19:46 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 Jul 16 11:19:46 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:46 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240" returned: 0 in 0.434s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Acquiring lock "cinder-748c0e01-89fe-4ba7-942b-250d3f68335f-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:46 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 1G Jul 16 11:19:46 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-748c0e01-89fe-4ba7-942b-250d3f68335f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Acquiring lock "cinder-quobyte-cc6f1329-3821-4d96-b18a-4397c2809f74" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-cc6f1329-3821-4d96-b18a-4397c2809f74" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Acquiring lock "cinder-quobyte-748c0e01-89fe-4ba7-942b-250d3f68335f" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-748c0e01-89fe-4ba7-942b-250d3f68335f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Deleting offline snapshot 748c0e01-89fe-4ba7-942b-250d3f68335f of volume cc6f1329-3821-4d96-b18a-4397c2809f74 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] snapshot_file for this snap is: volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[451a2fb2-f574-4a54-beb3-1f357672a38c]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:46 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f Jul 16 11:19:46 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:46 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 1G" returned: 0 in 0.479s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:46 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 Jul 16 11:19:46 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:46 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f" returned: 0 in 0.430s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc6f1329-3821-4d96-b18a-4397c2809f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[831cf741-b50a-4075-8a40-b7e1fa203f4d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:47 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 Jul 16 11:19:47 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:47 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43" returned: 0 in 0.350s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:47 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 is being set with open permissions: ugo+rw Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:47 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 Jul 16 11:19:47 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:47 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74" returned: 0 in 0.430s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:47 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f Jul 16 11:19:47 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:47 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43" returned: 0 in 0.293s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:47 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.info Jul 16 11:19:47 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:47 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f" returned: 0 in 0.402s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:47 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.info" returned: 0 in 0.309s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:47 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.info is being set with open permissions: ugo+rw Jul 16 11:19:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:47 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f Jul 16 11:19:47 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:47 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.info Jul 16 11:19:47 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:48 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:48 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74.748c0e01-89fe-4ba7-942b-250d3f68335f" returned: 0 in 0.313s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.info" returned: 0 in 0.298s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-748c0e01-89fe-4ba7-942b-250d3f68335f" released by "_delete_snapshot" :: held 1.759s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:48 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ed684224-9d4a-4812-aec6-b64bdcbacb6b tempest-ProjectMemberTests-1725097689 None] Create snapshot completed successfully Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-cc6f1329-3821-4d96-b18a-4397c2809f74" released by "delete_snapshot" :: held 1.794s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Created reservations ['28e7fc8d-6282-4333-a1d0-f27b5869df5f', 'b59cad18-ee5a-4bae-84d5-891dc56cc629', '5f8c0f1d-e46f-480d-b8a5-3fc35bd800f0', 'd0a43a10-5811-4932-90c0-ffd3932aaec5'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:48 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Delete snapshot completed successfully. Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-65185af3-67ca-4bb8-b51a-12ba41772b76 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-748c0e01-89fe-4ba7-942b-250d3f68335f-delete_snapshot" released by "delete_snapshot" :: held 1.953s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Acquiring lock "cinder-cc6f1329-3821-4d96-b18a-4397c2809f74-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-cc6f1329-3821-4d96-b18a-4397c2809f74-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Acquiring lock "cinder-quobyte-cc6f1329-3821-4d96-b18a-4397c2809f74" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-cc6f1329-3821-4d96-b18a-4397c2809f74" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[327dcc23-fa15-4e3c-9bd8-b0bd30c7e301]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:48 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 Jul 16 11:19:48 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:49 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74" returned: 0 in 0.435s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-0acce89c-8f2d-4a97-8a3e-6865412b3c43-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:49 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74 Jul 16 11:19:49 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-0acce89c-8f2d-4a97-8a3e-6865412b3c43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-7ffc0a61-4d99-48e9-aaa7-b087f62e7240" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-7ffc0a61-4d99-48e9-aaa7-b087f62e7240" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-0acce89c-8f2d-4a97-8a3e-6865412b3c43" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-0acce89c-8f2d-4a97-8a3e-6865412b3c43" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Deleting offline snapshot 0acce89c-8f2d-4a97-8a3e-6865412b3c43 of volume 7ffc0a61-4d99-48e9-aaa7-b087f62e7240 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] snapshot_file for this snap is: volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acd3c93-48e3-4738-beec-4bfb78dca6bc]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:49 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 Jul 16 11:19:49 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:49 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-cc6f1329-3821-4d96-b18a-4397c2809f74" returned: 0 in 0.281s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-cc6f1329-3821-4d96-b18a-4397c2809f74" released by "delete_volume" :: held 0.788s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Created reservations ['c121dcdd-bf4d-496b-8efd-1f92445ee418', '35db63df-f193-41fa-9de7-a5a0ff90a2be', '7f1c542d-50d9-4615-90fd-a780abcd6ab6', '43f3bda2-f05c-46de-b24c-485ff8463a28'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:49 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:49 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:49 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43" returned: 0 in 0.409s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2638feb8-ee3d-432e-9797-cffa80518331]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Acquiring lock "cinder-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Lock "cinder-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Acquiring lock "cinder-quobyte-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" acquired by "delete_volume" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:49 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 Jul 16 11:19:49 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06cead2-1537-4fc5-83e7-3e07579a9295]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:49 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.378s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Deleted volume successfully. Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-c2ce88e8-30e6-49db-a9c2-202835144480 tempest-VolumeDependencyTests-475878698 None] Lock "cinder-cc6f1329-3821-4d96-b18a-4397c2809f74-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:50 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 Jul 16 11:19:50 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Flow 'volume_create_manager' (207a439d-5f53-45db-9607-7327cac7005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd34524f-7748-4cb9-afe0-df19de735791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd34524f-7748-4cb9-afe0-df19de735791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8d0940-4823-4591-abfb-272cff072ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7804529ef00643a48c1531240d77ff53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:50Z,use_quota=True,user_id='f6e94f29c82140378533df65fbbfba53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77dda11-e7b3-4504-b8e5-ad45f259202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77dda11-e7b3-4504-b8e5-ad45f259202b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2953b143-71a0-43a4-9d44-0978c56a066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.image.glance [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Creating Keystone auth plugin from conf {{(pid=87345) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 11:19:50 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240" returned: 0 in 0.448s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:50 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 Jul 16 11:19:50 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:50 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" returned: 0 in 0.455s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:50 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426 Jul 16 11:19:50 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2953b143-71a0-43a4-9d44-0978c56a066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da8d0940-4823-4591-abfb-272cff072ebd', 'volume_name': 'volume-da8d0940-4823-4591-abfb-272cff072ebd', 'volume_size': 1, 'image_id': '978f3271-3a33-43be-aae9-cdeae101d86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/978f3271-3a33-43be-aae9-cdeae101d86b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19661a58d0bef8530576a7bf82a0654e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7804529ef00643a48c1531240d77ff53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee2c32d181f922b6d74e98a11696774f0fa0290f6ed15b363b04657e6bdc7a551d96a78f244280e283c24dccac74821d85d50de5da463f1aec554ec25f84ce8e', 'id': '978f3271-3a33-43be-aae9-cdeae101d86b', 'created_at': datetime.datetime(2026, 7, 16, 9, 19, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 19, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/978f3271-3a33-43be-aae9-cdeae101d86b/file', 'properties': {}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5679ae-0f6e-44b8-8ffb-8ca4d1c8a073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5679ae-0f6e-44b8-8ffb-8ca4d1c8a073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2639392-bb53-4bb3-beac-aea792ff4069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:50 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Volume da8d0940-4823-4591-abfb-272cff072ebd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da8d0940-4823-4591-abfb-272cff072ebd', 'volume_size': 1, 'image_id': '978f3271-3a33-43be-aae9-cdeae101d86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/978f3271-3a33-43be-aae9-cdeae101d86b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19661a58d0bef8530576a7bf82a0654e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7804529ef00643a48c1531240d77ff53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee2c32d181f922b6d74e98a11696774f0fa0290f6ed15b363b04657e6bdc7a551d96a78f244280e283c24dccac74821d85d50de5da463f1aec554ec25f84ce8e', 'id': '978f3271-3a33-43be-aae9-cdeae101d86b', 'created_at': datetime.datetime(2026, 7, 16, 9, 19, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 19, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/978f3271-3a33-43be-aae9-cdeae101d86b/file', 'properties': {}}, 'image_service': } Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Trying to clone da8d0940-4823-4591-abfb-272cff072ebd from image 978f3271-3a33-43be-aae9-cdeae101d86b at location (None, [{'url': 'file:///opt/stack/data/glance/images/978f3271-3a33-43be-aae9-cdeae101d86b', 'metadata': {}}]). {{(pid=87345) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 11:19:50 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Image download 0.00 MB at 0.00 MB/s Jul 16 11:19:50 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43" returned: 0 in 0.537s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:50 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" returned: 0 in 0.355s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[07080899-1574-4378-859b-d0f832472982]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:50 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43 Jul 16 11:19:50 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Lock "cinder-quobyte-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426" released by "delete_volume" :: held 0.873s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Created reservations ['ff5ef140-fac1-4c01-ad32-b25a25581172', '8db82e11-d74c-4719-be71-2fd0e14f042d', 'd9653337-f21d-4bdf-8d95-2c1879772477', '19d3b8c3-bef6-4dde-bd25-1b9bfd74b3df'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:50 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD Jul 16 11:19:50 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:51 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:51 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:51 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240.0acce89c-8f2d-4a97-8a3e-6865412b3c43" returned: 0 in 0.361s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-0acce89c-8f2d-4a97-8a3e-6865412b3c43" released by "_delete_snapshot" :: held 1.916s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-7ffc0a61-4d99-48e9-aaa7-b087f62e7240" released by "delete_snapshot" :: held 1.953s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:51 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:51 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.340s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:51 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Deleted volume successfully. Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Created reservations ['e5a9c634-7c4a-4104-be56-d50c32709125', '8832b6d2-b043-4878-805e-5cf58330313b', 'e2e6fe86-acd5-4e89-b85e-57bdc8f5c3c3', '56a056a8-1515-4b18-9e9d-db5f032be140'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8481b2b6-0492-4803-9134-f6aa45b1261e tempest-VolumeDependencyTests-475878698 None] Lock "cinder-d5541fb7-f6c4-4d0b-8519-27bc5d4cb426-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:51 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Delete snapshot completed successfully. Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6ba1fb15-25c6-438f-b9e3-1a39073012f8 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-0acce89c-8f2d-4a97-8a3e-6865412b3c43-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:51 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD Jul 16 11:19:51 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:51 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Temporary image 978f3271-3a33-43be-aae9-cdeae101d86b is fetched for user f6e94f29c82140378533df65fbbfba53. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[677425a6-e79e-4498-8278-e72e46915cbb]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:51 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD Jul 16 11:19:51 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:52 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:52 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD Jul 16 11:19:52 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:52 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8d0940-4823-4591-abfb-272cff072ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7804529ef00643a48c1531240d77ff53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:50Z,use_quota=True,user_id='f6e94f29c82140378533df65fbbfba53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Creating volume da8d0940-4823-4591-abfb-272cff072ebd {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:52 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-7ffc0a61-4d99-48e9-aaa7-b087f62e7240-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:52 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd 1073741824 Jul 16 11:19:52 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-7ffc0a61-4d99-48e9-aaa7-b087f62e7240-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-7ffc0a61-4d99-48e9-aaa7-b087f62e7240" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-7ffc0a61-4d99-48e9-aaa7-b087f62e7240" acquired by "delete_volume" :: waited 0.030s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[478a3196-9aa9-4b42-bd81-f3df4ba91f83]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:52 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 Jul 16 11:19:52 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:53 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd 1073741824" returned: 0 in 0.624s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:53 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240" returned: 0 in 0.462s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:53 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd Jul 16 11:19:53 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:53 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240 Jul 16 11:19:53 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:53 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd" returned: 0 in 0.304s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:53 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-7ffc0a61-4d99-48e9-aaa7-b087f62e7240" returned: 0 in 0.311s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-7ffc0a61-4d99-48e9-aaa7-b087f62e7240" released by "delete_volume" :: held 0.875s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Attempting download of 978f3271-3a33-43be-aae9-cdeae101d86b ((None, [{'url': 'file:///opt/stack/data/glance/images/978f3271-3a33-43be-aae9-cdeae101d86b', 'metadata': {}}])) to volume da8d0940-4823-4591-abfb-272cff072ebd. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed12718c-85ea-4308-a8a2-5c6b85fc0330]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_978f3271-3a33-43be-aae9-cdeae101d86b_1hxjoqk5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Created reservations ['111d83df-aa1a-4864-9502-b8da3660a100', '55cddd6f-7753-4666-b273-2da415b97c46', '8a49b946-99d8-4c75-b730-e196ab9a69f6', '7838dc74-7330-40ce-9657-3e6ec87fa393'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:53 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_978f3271-3a33-43be-aae9-cdeae101d86b_1hxjoqk5 Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:53 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:53 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:53 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:54 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.297s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:54 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Deleted volume successfully. Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d747cb01-034a-4407-9c37-077a0df40565 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-7ffc0a61-4d99-48e9-aaa7-b087f62e7240-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:54 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_978f3271-3a33-43be-aae9-cdeae101d86b_1hxjoqk5" returned: 0 in 0.527s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978f3271-3a33-43be-aae9-cdeae101d86b_1hxjoqk5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:54 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978f3271-3a33-43be-aae9-cdeae101d86b_1hxjoqk5 Jul 16 11:19:54 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:54 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978f3271-3a33-43be-aae9-cdeae101d86b_1hxjoqk5" returned: 1 in 0.404s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_978f3271-3a33-43be-aae9-cdeae101d86b_1hxjoqk5' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1916de-398d-4039-8c95-4121da3a0935]: (4, 'raw') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (1e297ffa-f448-4491-bc31-47bafda2e989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103d6276-ae0d-4270-8e3b-60cb12c68dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103d6276-ae0d-4270-8e3b-60cb12c68dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1124913561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46159355-d226-4588-8ff2-232621d87d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:54Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c9e893-534e-4e5b-9ca2-35991e00ef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c9e893-534e-4e5b-9ca2-35991e00ef9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4309342-5c68-4e39-bd41-639801c0c5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4309342-5c68-4e39-bd41-639801c0c5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46159355-d226-4588-8ff2-232621d87d43', 'volume_name': 'volume-46159355-d226-4588-8ff2-232621d87d43', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4f9ae6-a3d2-49e8-bda2-aa9c1ceaf485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4f9ae6-a3d2-49e8-bda2-aa9c1ceaf485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a8a2af-9c3a-434c-8e73-27320151612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:54 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Volume 46159355-d226-4588-8ff2-232621d87d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46159355-d226-4588-8ff2-232621d87d43', 'volume_size': 1} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1124913561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46159355-d226-4588-8ff2-232621d87d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:54Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Creating volume 46159355-d226-4588-8ff2-232621d87d43 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:54 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:54 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD Jul 16 11:19:54 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:54 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 1073741824 Jul 16 11:19:54 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:54 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:55 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD Jul 16 11:19:55 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:55 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 1073741824" returned: 0 in 0.574s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:55 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 Jul 16 11:19:55 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:55 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD" returned: 1 in 0.501s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] 978f3271-3a33-43be-aae9-cdeae101d86b was raw, converting to qcow2 {{(pid=87345) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:55 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd Jul 16 11:19:55 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:55 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43" returned: 0 in 0.383s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a8a2af-9c3a-434c-8e73-27320151612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46159355-d226-4588-8ff2-232621d87d43', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc24f12-75ec-49de-b33f-b9a037a2c6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:55 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Volume volume-46159355-d226-4588-8ff2-232621d87d43 (46159355-d226-4588-8ff2-232621d87d43): created successfully Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc24f12-75ec-49de-b33f-b9a037a2c6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:55 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (1e297ffa-f448-4491-bc31-47bafda2e989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:55 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-1c0b2d30-f991-4463-a527-8841cc892ef5 tempest-ProjectMemberTests-1725097689 None] Created volume successfully. Jul 16 11:19:56 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd" returned: 0 in 0.665s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_978f3271-3a33-43be-aae9-cdeae101d86b_hxeqjst7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:19:56 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:56 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd 1G Jul 16 11:19:56 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Flow 'volume_create_manager' (efd90321-45fd-4888-b211-79a0e33f7a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2858cde-5af8-42e7-b4e8-c528b272de1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2858cde-5af8-42e7-b4e8-c528b272de1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-382040002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0039b70e-6980-4225-90a3-b034aa16d804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb908d6341a42eb8491375d7757b663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:56Z,use_quota=True,user_id='7de404e019c446fcbe11cff520ddb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67b7a0d-8955-4f35-9973-c04349dd6076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67b7a0d-8955-4f35-9973-c04349dd6076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fe1c8f-6a3a-4991-ba42-d0a2f5faa005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fe1c8f-6a3a-4991-ba42-d0a2f5faa005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0039b70e-6980-4225-90a3-b034aa16d804', 'volume_name': 'volume-0039b70e-6980-4225-90a3-b034aa16d804', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f7d970-cb8d-4fd9-af34-e935711e99b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f7d970-cb8d-4fd9-af34-e935711e99b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a2844d-6c1f-4236-a559-5713fc21e926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:56 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Volume 0039b70e-6980-4225-90a3-b034aa16d804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0039b70e-6980-4225-90a3-b034aa16d804', 'volume_size': 1} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-382040002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0039b70e-6980-4225-90a3-b034aa16d804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb908d6341a42eb8491375d7757b663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:19:56Z,use_quota=True,user_id='7de404e019c446fcbe11cff520ddb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Creating volume 0039b70e-6980-4225-90a3-b034aa16d804 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:19:56 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:56 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 1073741824 Jul 16 11:19:56 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:56 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd 1G" returned: 0 in 0.367s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Downloaded image 978f3271-3a33-43be-aae9-cdeae101d86b ((None, [{'url': 'file:///opt/stack/data/glance/images/978f3271-3a33-43be-aae9-cdeae101d86b', 'metadata': {}}])) to volume da8d0940-4823-4591-abfb-272cff072ebd successfully. {{(pid=87345) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Temporary image 978f3271-3a33-43be-aae9-cdeae101d86b for user f6e94f29c82140378533df65fbbfba53 is deleted. {{(pid=87345) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.volume_utils [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Marking volume da8d0940-4823-4591-abfb-272cff072ebd as bootable. {{(pid=87345) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Copying metadata from image 978f3271-3a33-43be-aae9-cdeae101d86b to da8d0940-4823-4591-abfb-272cff072ebd. {{(pid=87345) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Creating volume glance metadata for volume da8d0940-4823-4591-abfb-272cff072ebd backed by image 978f3271-3a33-43be-aae9-cdeae101d86b with: {'image_id': '978f3271-3a33-43be-aae9-cdeae101d86b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '19661a58d0bef8530576a7bf82a0654e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87345) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2639392-bb53-4bb3-beac-aea792ff4069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8d0940-4823-4591-abfb-272cff072ebd', 'volume_size': 1, 'image_id': '978f3271-3a33-43be-aae9-cdeae101d86b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/978f3271-3a33-43be-aae9-cdeae101d86b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '19661a58d0bef8530576a7bf82a0654e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7804529ef00643a48c1531240d77ff53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee2c32d181f922b6d74e98a11696774f0fa0290f6ed15b363b04657e6bdc7a551d96a78f244280e283c24dccac74821d85d50de5da463f1aec554ec25f84ce8e', 'id': '978f3271-3a33-43be-aae9-cdeae101d86b', 'created_at': datetime.datetime(2026, 7, 16, 9, 19, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 9, 19, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/978f3271-3a33-43be-aae9-cdeae101d86b/file', 'properties': {}}, 'image_service': }' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba5636c-3228-4cce-9308-751b44fd2f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:56 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Volume volume-da8d0940-4823-4591-abfb-272cff072ebd (da8d0940-4823-4591-abfb-272cff072ebd): created successfully Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba5636c-3228-4cce-9308-751b44fd2f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Flow 'volume_create_manager' (207a439d-5f53-45db-9607-7327cac7005a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:56 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-64348126-9317-4fef-9215-640ef0bd38c9 tempest-VolumeImageDependencyTests-1897554434 None] Created volume successfully. Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:56 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 1073741824" returned: 0 in 0.547s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:56 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 Jul 16 11:19:56 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:57 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804" returned: 0 in 0.251s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.305s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] Creating offline snapshot 693e78ca-ddc9-41b1-bf73-d2470ffbd96e of volume 46159355-d226-4588-8ff2-232621d87d43 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a2844d-6c1f-4236-a559-5713fc21e926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0039b70e-6980-4225-90a3-b034aa16d804', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd0043d-8331-4622-a5c2-fe8cc877d5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[943e5131-c1b0-411e-be3f-efd408ab5f2e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:57 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Volume volume-0039b70e-6980-4225-90a3-b034aa16d804 (0039b70e-6980-4225-90a3-b034aa16d804): created successfully Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd0043d-8331-4622-a5c2-fe8cc877d5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Flow 'volume_create_manager' (efd90321-45fd-4888-b211-79a0e33f7a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:19:57 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-40d0258a-b931-409a-9040-7859eb9790e7 tempest-ProjectReaderTests-2042638655 None] Created volume successfully. Jul 16 11:19:57 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 Jul 16 11:19:57 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:57 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43" returned: 0 in 0.408s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:57 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e 1G Jul 16 11:19:57 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Acquiring lock "cinder-da8d0940-4823-4591-abfb-272cff072ebd-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Lock "cinder-da8d0940-4823-4591-abfb-272cff072ebd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Acquiring lock "cinder-quobyte-da8d0940-4823-4591-abfb-272cff072ebd" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Lock "cinder-quobyte-da8d0940-4823-4591-abfb-272cff072ebd" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1776d8-16c0-4ad7-a093-7673782ffc7c]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:57 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd Jul 16 11:19:57 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:58 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e 1G" returned: 0 in 0.489s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46159355-d226-4588-8ff2-232621d87d43 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:58 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46159355-d226-4588-8ff2-232621d87d43 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e Jul 16 11:19:58 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:58 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd" returned: 0 in 0.431s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:58 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd Jul 16 11:19:58 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:58 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46159355-d226-4588-8ff2-232621d87d43 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e" returned: 0 in 0.352s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:58 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e is being set with open permissions: ugo+rw Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:58 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e Jul 16 11:19:58 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:58 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-da8d0940-4823-4591-abfb-272cff072ebd" returned: 0 in 0.307s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Lock "cinder-quobyte-da8d0940-4823-4591-abfb-272cff072ebd" released by "delete_volume" :: held 0.816s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Created reservations ['38df12e9-4b33-46f6-8b45-0bfbb1ddad30', '7dff5c8e-4a6e-4568-aae5-32bdd03af7e0', '2d9443f5-7c53-4106-b65e-cdb01af11a1a', '388cfdbd-a023-4bde-9311-51058efe4179'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:58 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e" returned: 0 in 0.334s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:58 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:19:58 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:58 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.info Jul 16 11:19:58 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:59 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.315s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:19:59 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Deleted volume successfully. Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-007903f3-e6de-4363-97d7-6bcf66b514fc tempest-VolumeImageDependencyTests-1897554434 None] Lock "cinder-da8d0940-4823-4591-abfb-272cff072ebd-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:19:59 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.info" returned: 0 in 0.330s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:59 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.info is being set with open permissions: ugo+rw Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:59 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.info Jul 16 11:19:59 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:59 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.info" returned: 0 in 0.265s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.807s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] Creating offline snapshot 444f106e-7b10-4a82-9be8-3ab7b2647e88 of volume 0039b70e-6980-4225-90a3-b034aa16d804 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:19:59 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b8f28945-7213-4a04-b118-9a5544071380 tempest-ProjectMemberTests-1725097689 None] Create snapshot completed successfully Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99b4275-b2ee-45e6-9fc3-9bc0ac72f6e5]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:59 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 Jul 16 11:19:59 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:19:59 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804" returned: 0 in 0.398s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:19:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:19:59 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 1G Jul 16 11:19:59 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-693e78ca-ddc9-41b1-bf73-d2470ffbd96e-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-693e78ca-ddc9-41b1-bf73-d2470ffbd96e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-46159355-d226-4588-8ff2-232621d87d43" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-46159355-d226-4588-8ff2-232621d87d43" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-693e78ca-ddc9-41b1-bf73-d2470ffbd96e" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-693e78ca-ddc9-41b1-bf73-d2470ffbd96e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Deleting offline snapshot 693e78ca-ddc9-41b1-bf73-d2470ffbd96e of volume 46159355-d226-4588-8ff2-232621d87d43 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] snapshot_file for this snap is: volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8368459f-a27a-4c00-a33e-5bdd1bf4d8b7]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:00 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e Jul 16 11:20:00 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:00 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 1G" returned: 0 in 0.555s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0039b70e-6980-4225-90a3-b034aa16d804 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:00 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0039b70e-6980-4225-90a3-b034aa16d804 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 Jul 16 11:20:00 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:00 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e" returned: 0 in 0.468s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46159355-d226-4588-8ff2-232621d87d43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb07f1b-b1e9-4db3-b165-88ce8118bfaa]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:00 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 Jul 16 11:20:00 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:00 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0039b70e-6980-4225-90a3-b034aa16d804 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88" returned: 0 in 0.420s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:00 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 is being set with open permissions: ugo+rw Jul 16 11:20:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:00 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 Jul 16 11:20:00 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:01 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43" returned: 0 in 0.483s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:01 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88" returned: 0 in 0.335s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=207,cinder:UPDATE=258,cinder:INSERT=72,cinder:DELETE=24 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:20:01 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e Jul 16 11:20:01 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=290,cinder:SELECT=196,cinder:DELETE=26,cinder:INSERT=74 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:01 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.info Jul 16 11:20:01 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:01 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e" returned: 0 in 0.407s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:01 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e Jul 16 11:20:01 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:01 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.info" returned: 0 in 0.380s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:01 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.info is being set with open permissions: ugo+rw Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:01 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.info Jul 16 11:20:01 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:01 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43.693e78ca-ddc9-41b1-bf73-d2470ffbd96e" returned: 0 in 0.331s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-693e78ca-ddc9-41b1-bf73-d2470ffbd96e" released by "_delete_snapshot" :: held 1.865s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-46159355-d226-4588-8ff2-232621d87d43" released by "delete_snapshot" :: held 1.897s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:01 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.info" returned: 0 in 0.327s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.578s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:02 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-63dd5300-0b4f-4772-9989-548a23fb3c3d tempest-ProjectReaderTests-2042638655 None] Create snapshot completed successfully Jul 16 11:20:02 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Created reservations ['b01f8466-3391-4cad-ac58-55a72c5ec056', '6b9a1b03-5ee8-47af-826a-18a453b1bd84', 'adb40aa6-680c-4406-b4a2-4384524264a2', 'f379c878-91a3-4c0e-8196-7cae58c95ad1'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:02 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Delete snapshot completed successfully. Jul 16 11:20:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-f772a38c-10cc-4acb-8f44-4de1f82f9b86 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-693e78ca-ddc9-41b1-bf73-d2470ffbd96e-delete_snapshot" released by "delete_snapshot" :: held 2.116s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-46159355-d226-4588-8ff2-232621d87d43-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-46159355-d226-4588-8ff2-232621d87d43-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-46159355-d226-4588-8ff2-232621d87d43" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:02 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-46159355-d226-4588-8ff2-232621d87d43" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:02 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98f4c14-2fb9-424d-8acc-75968003990a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:02 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 Jul 16 11:20:02 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:02 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43" returned: 0 in 0.434s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:02 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43 Jul 16 11:20:02 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-444f106e-7b10-4a82-9be8-3ab7b2647e88-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-444f106e-7b10-4a82-9be8-3ab7b2647e88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-0039b70e-6980-4225-90a3-b034aa16d804" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-0039b70e-6980-4225-90a3-b034aa16d804" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-444f106e-7b10-4a82-9be8-3ab7b2647e88" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-444f106e-7b10-4a82-9be8-3ab7b2647e88" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Deleting offline snapshot 444f106e-7b10-4a82-9be8-3ab7b2647e88 of volume 0039b70e-6980-4225-90a3-b034aa16d804 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] snapshot_file for this snap is: volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d187c3-a374-42b7-807a-6318987e7e13]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:03 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-46159355-d226-4588-8ff2-232621d87d43" returned: 0 in 0.363s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Flow 'volume_create_manager' (cb066782-f6cc-4949-a85b-48148ab02e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d780dcb-e66d-4d60-9ffe-a3f5f457f303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-46159355-d226-4588-8ff2-232621d87d43" released by "delete_volume" :: held 0.912s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d780dcb-e66d-4d60-9ffe-a3f5f457f303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f487e1a0-264c-4bd7-9e26-c3b19f6f53fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d392f5ec52d74a1ea6abfebf942e305c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:03Z,use_quota=True,user_id='5af1c94ec0174631bdc2e3bfe2d93b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d887b5d-b170-4b67-8512-12d8b11db52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d887b5d-b170-4b67-8512-12d8b11db52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e64160-d439-415b-948c-2d48c621e042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e64160-d439-415b-948c-2d48c621e042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f487e1a0-264c-4bd7-9e26-c3b19f6f53fd', 'volume_name': 'volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b38177-80f6-4a7a-a2fd-9e363653b0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b38177-80f6-4a7a-a2fd-9e363653b0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f51a659-68cd-49e4-9172-dfb3fb447534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:03 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Volume f487e1a0-264c-4bd7-9e26-c3b19f6f53fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd', 'volume_size': 1} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:03 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 Jul 16 11:20:03 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f487e1a0-264c-4bd7-9e26-c3b19f6f53fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d392f5ec52d74a1ea6abfebf942e305c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:03Z,use_quota=True,user_id='5af1c94ec0174631bdc2e3bfe2d93b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Creating volume f487e1a0-264c-4bd7-9e26-c3b19f6f53fd {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:03 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:03 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd 1073741824 Jul 16 11:20:03 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Created reservations ['5ecc7fff-084d-4620-a394-c8f23f9a2496', 'd9d7c786-1577-4f2b-9a91-674f3fe5cf31', '3aaca5d6-aea9-4e35-98bc-62db216cd592', '35cb8df9-68fe-4365-96b2-852239a26fd0'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:03 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:03 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:03 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88" returned: 0 in 0.477s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0039b70e-6980-4225-90a3-b034aa16d804(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f10d40-e810-4ac7-b535-a4184967cd45]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:03 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.307s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:03 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Deleted volume successfully. Jul 16 11:20:03 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 Jul 16 11:20:03 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6fe016a3-1ab1-4f3c-9dda-0f140136d0a4 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-46159355-d226-4588-8ff2-232621d87d43-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:03 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd 1073741824" returned: 0 in 0.563s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:03 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd Jul 16 11:20:03 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:04 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804" returned: 0 in 0.479s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:04 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 Jul 16 11:20:04 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:04 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd" returned: 0 in 0.285s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f51a659-68cd-49e4-9172-dfb3fb447534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511497d6-9f3a-4ae0-bc1d-8f03b1d99a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:04 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Volume volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd (f487e1a0-264c-4bd7-9e26-c3b19f6f53fd): created successfully Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511497d6-9f3a-4ae0-bc1d-8f03b1d99a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Flow 'volume_create_manager' (cb066782-f6cc-4949-a85b-48148ab02e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:04 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-cae3a4aa-a0a4-4d6a-9fcc-38cf2ed6ac72 tempest-CinderUnicodeTest-651707819 None] Created volume successfully. Jul 16 11:20:04 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88" returned: 0 in 0.372s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:04 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88 Jul 16 11:20:04 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:04 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804.444f106e-7b10-4a82-9be8-3ab7b2647e88" returned: 0 in 0.268s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-444f106e-7b10-4a82-9be8-3ab7b2647e88" released by "_delete_snapshot" :: held 1.741s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-0039b70e-6980-4225-90a3-b034aa16d804" released by "delete_snapshot" :: held 1.781s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:04 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Created reservations ['6ed86a4b-5145-4969-847c-15f272d7e24c', 'a0c5078b-cbcb-414d-b4f9-bb6085209ca1', 'e853a3d0-d446-46ef-a225-87a27f417d55', '376553c6-bf37-4870-91f0-cbd60b7d0631'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:05 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Delete snapshot completed successfully. Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a4c3ef3-db72-4fdf-b002-cfa120f2ca26 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-444f106e-7b10-4a82-9be8-3ab7b2647e88-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (5dbc9a87-982e-4fed-9f1e-a61d07d9eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0fd824-1a1c-4a69-b944-0b3d3ecb6f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0fd824-1a1c-4a69-b944-0b3d3ecb6f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1818714233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412b86d8-dbf7-40ec-830c-91b8bac8f2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:05Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f649d1-fb4f-41d2-aecc-f80cd6dcf185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f649d1-fb4f-41d2-aecc-f80cd6dcf185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bf996e-7e8a-4183-b361-026fc1996c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bf996e-7e8a-4183-b361-026fc1996c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '412b86d8-dbf7-40ec-830c-91b8bac8f2ab', 'volume_name': 'volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f206c3f9-5ae7-4f55-9b2a-90f174635b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f206c3f9-5ae7-4f55-9b2a-90f174635b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d79467b-9dee-4166-a3de-3a81ca0d4e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:05 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Volume 412b86d8-dbf7-40ec-830c-91b8bac8f2ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab', 'volume_size': 1} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1818714233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412b86d8-dbf7-40ec-830c-91b8bac8f2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:05Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Creating volume 412b86d8-dbf7-40ec-830c-91b8bac8f2ab {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:05 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-0039b70e-6980-4225-90a3-b034aa16d804-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:05 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab 1073741824 Jul 16 11:20:05 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Lock "cinder-0039b70e-6980-4225-90a3-b034aa16d804-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-0039b70e-6980-4225-90a3-b034aa16d804" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-0039b70e-6980-4225-90a3-b034aa16d804" acquired by "delete_volume" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[354848bb-2f4a-451c-99d8-128c511fe4e8]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:05 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 Jul 16 11:20:05 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:05 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab 1073741824" returned: 0 in 0.605s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:05 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:05 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804" returned: 0 in 0.481s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:05 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:05 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804 Jul 16 11:20:05 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Flow 'volume_create_manager' (7166ccbb-5ba4-4a14-826c-f3a3f19bf534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75393e4e-3c13-4a6d-97a3-d6bcc1dcf7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75393e4e-3c13-4a6d-97a3-d6bcc1dcf7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2136999592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42035fb-f961-4327-b078-318cd2509a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d392f5ec52d74a1ea6abfebf942e305c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:06Z,use_quota=True,user_id='5af1c94ec0174631bdc2e3bfe2d93b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347856a7-182c-43b2-9ff1-7843930ed22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347856a7-182c-43b2-9ff1-7843930ed22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ded757b-badb-4384-876d-f0333c61cb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ded757b-badb-4384-876d-f0333c61cb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e42035fb-f961-4327-b078-318cd2509a6a', 'volume_name': 'volume-e42035fb-f961-4327-b078-318cd2509a6a', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7802f42c-68b1-4189-b287-3df1776a6020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7802f42c-68b1-4189-b287-3df1776a6020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c2b7fb-3345-43a8-bce0-ff668880d261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:06 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Volume e42035fb-f961-4327-b078-318cd2509a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e42035fb-f961-4327-b078-318cd2509a6a', 'volume_size': 1} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:06 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab" returned: 0 in 0.294s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2136999592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42035fb-f961-4327-b078-318cd2509a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d392f5ec52d74a1ea6abfebf942e305c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:06Z,use_quota=True,user_id='5af1c94ec0174631bdc2e3bfe2d93b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Creating volume e42035fb-f961-4327-b078-318cd2509a6a {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:06 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:06 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0039b70e-6980-4225-90a3-b034aa16d804" returned: 0 in 0.298s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:06 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a 1073741824 Jul 16 11:20:06 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d79467b-9dee-4166-a3de-3a81ca0d4e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194ecd8b-fab4-43eb-9aff-b7e5bbef6ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-0039b70e-6980-4225-90a3-b034aa16d804" released by "delete_volume" :: held 0.867s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:06 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Volume volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab (412b86d8-dbf7-40ec-830c-91b8bac8f2ab): created successfully Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194ecd8b-fab4-43eb-9aff-b7e5bbef6ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (5dbc9a87-982e-4fed-9f1e-a61d07d9eda4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:06 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-97d2d90e-3da1-4514-afce-d622555ca2a1 tempest-ProjectMemberTests-1725097689 None] Created volume successfully. Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Created reservations ['cf8d9758-5e7d-40ab-a816-9a3715f114de', '77db193a-cbd7-46e7-9d29-ecefe14f2146', 'ee25ad48-21f6-46da-8b87-1a2d52a12964', 'e95bc7a6-13c4-4572-82b7-82e9615ef68b'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:06 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:06 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:06 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a 1073741824" returned: 0 in 0.491s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:06 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.302s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:06 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Deleted volume successfully. Jul 16 11:20:06 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a Jul 16 11:20:06 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e204076d-e956-4e15-890f-8d4f82a6509d tempest-ProjectReaderTests-2042638655 None] Lock "cinder-0039b70e-6980-4225-90a3-b034aa16d804-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:07 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a" returned: 0 in 0.268s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c2b7fb-3345-43a8-bce0-ff668880d261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42035fb-f961-4327-b078-318cd2509a6a', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ed12c6-6d35-4caa-9667-0fb8c958e4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:07 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Volume volume-e42035fb-f961-4327-b078-318cd2509a6a (e42035fb-f961-4327-b078-318cd2509a6a): created successfully Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ed12c6-6d35-4caa-9667-0fb8c958e4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Flow 'volume_create_manager' (7166ccbb-5ba4-4a14-826c-f3a3f19bf534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:07 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-931ab00d-14d2-40a6-80a5-cc91faa25b77 tempest-CinderUnicodeTest-651707819 None] Created volume successfully. Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] Creating offline snapshot 9181bc49-4ab8-4cfa-b521-d8f3feca3d6a of volume 412b86d8-dbf7-40ec-830c-91b8bac8f2ab {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa83877d-e083-43f3-a0a2-7acd75dfe23b]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:07 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab Jul 16 11:20:07 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:07 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab" returned: 0 in 0.383s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:07 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a 1G Jul 16 11:20:07 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Flow 'volume_create_manager' (024550b9-647d-424a-b44c-a73722a73ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7118424e-67bf-4c39-8c4c-03c6b5a340a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7118424e-67bf-4c39-8c4c-03c6b5a340a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-276093911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9361770e-ac5d-4dc8-b89e-44bde5706b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb908d6341a42eb8491375d7757b663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:08Z,use_quota=True,user_id='7de404e019c446fcbe11cff520ddb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0be1f32-355e-483d-b849-d965dc0d3109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0be1f32-355e-483d-b849-d965dc0d3109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e34378-8f33-410c-9b53-60c3288e67f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e34378-8f33-410c-9b53-60c3288e67f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9361770e-ac5d-4dc8-b89e-44bde5706b69', 'volume_name': 'volume-9361770e-ac5d-4dc8-b89e-44bde5706b69', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2509fef1-6ccb-4ee7-a0d3-b99466d3cc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2509fef1-6ccb-4ee7-a0d3-b99466d3cc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabd6e44-130d-42ae-ac02-8423422f62f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:08 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Volume 9361770e-ac5d-4dc8-b89e-44bde5706b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9361770e-ac5d-4dc8-b89e-44bde5706b69', 'volume_size': 1} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:08 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a 1G" returned: 0 in 0.525s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:08 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a Jul 16 11:20:08 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:08 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a" returned: 0 in 0.406s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:08 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a is being set with open permissions: ugo+rw Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:08 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a Jul 16 11:20:08 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:08 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a" returned: 0 in 0.241s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:09 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.info Jul 16 11:20:09 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:09 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.info" returned: 0 in 0.269s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:09 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.info is being set with open permissions: ugo+rw Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:09 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.info Jul 16 11:20:09 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:09 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.info" returned: 0 in 0.262s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-276093911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9361770e-ac5d-4dc8-b89e-44bde5706b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb908d6341a42eb8491375d7757b663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:08Z,use_quota=True,user_id='7de404e019c446fcbe11cff520ddb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Creating volume 9361770e-ac5d-4dc8-b89e-44bde5706b69 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:09 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:09 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 1073741824 Jul 16 11:20:09 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-171fb7ac-7552-497b-ad33-2b6d5beb82a3 tempest-ProjectMemberTests-1725097689 None] Create snapshot completed successfully Jul 16 11:20:10 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 1073741824" returned: 0 in 0.443s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:10 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 Jul 16 11:20:10 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:10 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69" returned: 0 in 0.257s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.029s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabd6e44-130d-42ae-ac02-8423422f62f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9361770e-ac5d-4dc8-b89e-44bde5706b69', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e00c37-7975-4c33-9214-8c2a8a87be6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] Creating offline snapshot 6eb1d34f-a4e5-42b5-be7d-ac528465023c of volume e42035fb-f961-4327-b078-318cd2509a6a {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:20:10 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Volume volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 (9361770e-ac5d-4dc8-b89e-44bde5706b69): created successfully Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e00c37-7975-4c33-9214-8c2a8a87be6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Flow 'volume_create_manager' (024550b9-647d-424a-b44c-a73722a73ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[9018b23a-1f10-4bb4-b289-2ae97eb88f0a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:10 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-0c7f8155-aee3-443f-93de-4563080c5972 tempest-ProjectReaderTests-2042638655 None] Created volume successfully. Jul 16 11:20:10 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a Jul 16 11:20:10 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-9181bc49-4ab8-4cfa-b521-d8f3feca3d6a-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-9181bc49-4ab8-4cfa-b521-d8f3feca3d6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-412b86d8-dbf7-40ec-830c-91b8bac8f2ab" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-412b86d8-dbf7-40ec-830c-91b8bac8f2ab" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-9181bc49-4ab8-4cfa-b521-d8f3feca3d6a" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-9181bc49-4ab8-4cfa-b521-d8f3feca3d6a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Deleting offline snapshot 9181bc49-4ab8-4cfa-b521-d8f3feca3d6a of volume 412b86d8-dbf7-40ec-830c-91b8bac8f2ab {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] snapshot_file for this snap is: volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[337f41ca-04d3-4cc2-827e-00cbe5175a9d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:10 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a" returned: 0 in 0.434s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:10 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c 1G Jul 16 11:20:10 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:10 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a Jul 16 11:20:10 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:11 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a" returned: 0 in 0.439s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:11 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:11 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6759f0-bff9-4943-b957-40103dab5914]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:11 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab Jul 16 11:20:11 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:11 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c 1G" returned: 0 in 0.606s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e42035fb-f961-4327-b078-318cd2509a6a -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:11 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e42035fb-f961-4327-b078-318cd2509a6a -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c Jul 16 11:20:11 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:11 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab" returned: 0 in 0.450s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:11 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a Jul 16 11:20:11 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:11 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e42035fb-f961-4327-b078-318cd2509a6a -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c" returned: 0 in 0.366s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:11 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c is being set with open permissions: ugo+rw Jul 16 11:20:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:11 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c Jul 16 11:20:11 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:12 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a" returned: 0 in 0.389s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:12 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c" returned: 0 in 0.268s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:12 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a Jul 16 11:20:12 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:12 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.info Jul 16 11:20:12 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:12 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab.9181bc49-4ab8-4cfa-b521-d8f3feca3d6a" returned: 0 in 0.262s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-9181bc49-4ab8-4cfa-b521-d8f3feca3d6a" released by "_delete_snapshot" :: held 1.660s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-412b86d8-dbf7-40ec-830c-91b8bac8f2ab" released by "delete_snapshot" :: held 1.690s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:12 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.info" returned: 0 in 0.286s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:12 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.info is being set with open permissions: ugo+rw Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:12 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.info Jul 16 11:20:12 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Created reservations ['0f304fe5-fc38-47ed-a427-351f7d5428d8', 'bb1e2f5f-a918-478e-96d9-06f6af0eeb85', '1e41af26-37dd-4470-b815-6ea8ac1feeb9', '12cbd772-5d66-4afc-8f90-68b97475cd3d'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:12 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Delete snapshot completed successfully. Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9ed6f941-448f-4b59-b35f-4aa24668e769 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-9181bc49-4ab8-4cfa-b521-d8f3feca3d6a-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:12 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.info" returned: 0 in 0.307s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.283s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] Creating offline snapshot fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 of volume 9361770e-ac5d-4dc8-b89e-44bde5706b69 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaf2ba3-4bfd-42fd-a451-5363ac13c800]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-412b86d8-dbf7-40ec-830c-91b8bac8f2ab-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:12 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-38d4d87b-3793-457f-8f07-978b9f354651 tempest-CinderUnicodeTest-651707819 None] Create snapshot completed successfully Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Lock "cinder-412b86d8-dbf7-40ec-830c-91b8bac8f2ab-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-412b86d8-dbf7-40ec-830c-91b8bac8f2ab" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-412b86d8-dbf7-40ec-830c-91b8bac8f2ab" acquired by "delete_volume" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:12 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 Jul 16 11:20:12 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ed4005-3181-4ba1-b9aa-7a67f5409de1]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:13 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab Jul 16 11:20:13 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:13 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69" returned: 0 in 0.431s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:13 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 1G Jul 16 11:20:13 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:13 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab" returned: 0 in 0.411s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:13 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab Jul 16 11:20:13 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Acquiring lock "cinder-6eb1d34f-a4e5-42b5-be7d-ac528465023c-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Lock "cinder-6eb1d34f-a4e5-42b5-be7d-ac528465023c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Acquiring lock "cinder-quobyte-e42035fb-f961-4327-b078-318cd2509a6a" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Lock "cinder-quobyte-e42035fb-f961-4327-b078-318cd2509a6a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Acquiring lock "cinder-quobyte-6eb1d34f-a4e5-42b5-be7d-ac528465023c" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Lock "cinder-quobyte-6eb1d34f-a4e5-42b5-be7d-ac528465023c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Deleting offline snapshot 6eb1d34f-a4e5-42b5-be7d-ac528465023c of volume e42035fb-f961-4327-b078-318cd2509a6a {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] snapshot_file for this snap is: volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de6ecf6-4e25-4ccf-8451-81e0a5f48ac3]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:13 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-412b86d8-dbf7-40ec-830c-91b8bac8f2ab" returned: 0 in 0.349s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-412b86d8-dbf7-40ec-830c-91b8bac8f2ab" released by "delete_volume" :: held 0.846s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:13 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 1G" returned: 0 in 0.605s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Created reservations ['6c11895c-3341-4f48-af08-a5a67af2bf6c', 'fcb0c0d2-d5f2-4f82-8b3b-c9fa057ad0a8', 'e1305a08-66f2-4582-8b4a-00456e60b37c', 'b95dc8b1-a786-4d08-8211-da7daaa64e73'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:13 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 Jul 16 11:20:13 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:13 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c Jul 16 11:20:13 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:13 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:13 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:14 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c" returned: 0 in 0.462s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e42035fb-f961-4327-b078-318cd2509a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:14 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9" returned: 0 in 0.395s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:14 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 is being set with open permissions: ugo+rw Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eeca66-09b3-4a1a-a645-f66369420cff]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:14 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 Jul 16 11:20:14 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:14 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.388s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:14 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Deleted volume successfully. Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-748d1036-4e81-45f4-bd00-c617207092ea tempest-ProjectMemberTests-1725097689 None] Lock "cinder-412b86d8-dbf7-40ec-830c-91b8bac8f2ab-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:14 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a Jul 16 11:20:14 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:14 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9" returned: 0 in 0.394s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (66638800-323c-4a62-82e1-2756b985f5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bdd348-26b6-43c8-88f8-909bbf32342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:14 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.info Jul 16 11:20:14 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14bdd348-26b6-43c8-88f8-909bbf32342c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555397407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f469c54a-9f92-4a01-b23f-8a8b4b50421f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:15Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e4b07c-5123-4135-b0ad-896b0e01768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e4b07c-5123-4135-b0ad-896b0e01768b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d34b3b-be1a-426f-b0d8-472d037fd6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d34b3b-be1a-426f-b0d8-472d037fd6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f469c54a-9f92-4a01-b23f-8a8b4b50421f', 'volume_name': 'volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7ac5fe-fb66-4be5-a731-9a8fca827677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d7ac5fe-fb66-4be5-a731-9a8fca827677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff62cc2-cb71-4ed9-bddf-941dc98223df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:14 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Volume f469c54a-9f92-4a01-b23f-8a8b4b50421f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f', 'volume_size': 1} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:14 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a" returned: 0 in 0.653s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:14 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c Jul 16 11:20:14 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:14 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.info" returned: 0 in 0.281s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:14 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.info is being set with open permissions: ugo+rw Jul 16 11:20:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:15 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.info Jul 16 11:20:15 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:15 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c" returned: 0 in 0.399s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:15 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.info" returned: 0 in 0.319s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:15 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c Jul 16 11:20:15 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.473s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-555397407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f469c54a-9f92-4a01-b23f-8a8b4b50421f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:15Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Creating volume f469c54a-9f92-4a01-b23f-8a8b4b50421f {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:15 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:15 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f 1073741824 Jul 16 11:20:15 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b4840154-55c4-416a-b4a4-97729f8987cf tempest-ProjectReaderTests-2042638655 None] Create snapshot completed successfully Jul 16 11:20:15 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a.6eb1d34f-a4e5-42b5-be7d-ac528465023c" returned: 0 in 0.306s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Lock "cinder-quobyte-6eb1d34f-a4e5-42b5-be7d-ac528465023c" released by "_delete_snapshot" :: held 2.012s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Lock "cinder-quobyte-e42035fb-f961-4327-b078-318cd2509a6a" released by "delete_snapshot" :: held 2.048s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-9361770e-ac5d-4dc8-b89e-44bde5706b69" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-9361770e-ac5d-4dc8-b89e-44bde5706b69" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Deleting offline snapshot fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 of volume 9361770e-ac5d-4dc8-b89e-44bde5706b69 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] snapshot_file for this snap is: volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[007db9f2-9780-4cc1-99e3-6d3077c388b9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Created reservations ['5faf25f7-54b7-4ce9-bed6-4a97fb49e4cf', '4ff00c89-c2cf-4c9d-ad13-562ecaefaa34', '761ff53c-bc67-4101-af53-de0949957779', '34197198-8fa8-4cb2-b616-80ce974dfcb9'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Delete snapshot completed successfully. Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-0ef72290-335e-4342-b614-a9cc0496af83 tempest-CinderUnicodeTest-651707819 None] Lock "cinder-6eb1d34f-a4e5-42b5-be7d-ac528465023c-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:15 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f 1073741824" returned: 0 in 0.570s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:15 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 Jul 16 11:20:15 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:15 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f Jul 16 11:20:15 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:16 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f" returned: 0 in 0.284s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:16 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9" returned: 0 in 0.458s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9361770e-ac5d-4dc8-b89e-44bde5706b69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff62cc2-cb71-4ed9-bddf-941dc98223df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f581b0d-2dfb-4806-abbb-b7de47628e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[37689b6a-8303-4cd9-8245-69624c95b83a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:16 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Volume volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f (f469c54a-9f92-4a01-b23f-8a8b4b50421f): created successfully Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f581b0d-2dfb-4806-abbb-b7de47628e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (66638800-323c-4a62-82e1-2756b985f5b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:16 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-17af89c2-d13c-48bb-a389-e23a2ccbcf33 tempest-ProjectMemberTests-1725097689 None] Created volume successfully. Jul 16 11:20:16 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 Jul 16 11:20:16 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:16 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69" returned: 0 in 0.453s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:16 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 Jul 16 11:20:16 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Acquiring lock "cinder-e42035fb-f961-4327-b078-318cd2509a6a-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Lock "cinder-e42035fb-f961-4327-b078-318cd2509a6a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:16 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Acquiring lock "cinder-quobyte-e42035fb-f961-4327-b078-318cd2509a6a" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] Creating offline snapshot 53002c8c-57df-41ca-ac08-db74d6359096 of volume f469c54a-9f92-4a01-b23f-8a8b4b50421f {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Lock "cinder-quobyte-e42035fb-f961-4327-b078-318cd2509a6a" acquired by "delete_volume" :: waited 0.028s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0084dc4-7065-45d3-ac0a-193b0b48de3d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa6af60-6c62-4f19-8b55-2f218b1214b3]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:17 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f Jul 16 11:20:17 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:17 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a Jul 16 11:20:17 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:17 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9" returned: 0 in 0.564s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:17 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9 Jul 16 11:20:17 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:17 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a" returned: 0 in 0.435s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:17 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f" returned: 0 in 0.475s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:17 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a Jul 16 11:20:17 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:17 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 1G Jul 16 11:20:17 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:17 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69.fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9" returned: 0 in 0.339s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9" released by "_delete_snapshot" :: held 1.952s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-9361770e-ac5d-4dc8-b89e-44bde5706b69" released by "delete_snapshot" :: held 1.981s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:17 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-e42035fb-f961-4327-b078-318cd2509a6a" returned: 0 in 0.317s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Created reservations ['5106e0c6-8b47-4f4e-b6c1-7120ad6c7e69', '4cae81df-9015-4df0-b4a6-a0abdf24c590', '17e4ef18-80cf-4775-9c30-c9a65121b25b', '6297dd50-89f6-4c16-bec8-b4c8c789d8cd'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Lock "cinder-quobyte-e42035fb-f961-4327-b078-318cd2509a6a" released by "delete_volume" :: held 0.830s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:17 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Delete snapshot completed successfully. Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d4ad7b79-1dcb-4017-a3f2-d58e5b4a7d36 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-fbe06cc5-cf9a-46b1-a6fc-3cbd634fb8b9-delete_snapshot" released by "delete_snapshot" :: held 2.262s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:17 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Created reservations ['249bdacb-2bbd-4ac6-af71-015fb4b2b9cf', 'de7f502a-f1a9-43b3-8256-9f5506d3f640', '575b67bb-d155-422b-bffb-c0ca65663f0e', 'afb4c7d0-18de-4036-823a-43d22ca8d8f8'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:18 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 1G" returned: 0 in 0.538s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:18 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:18 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:18 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 Jul 16 11:20:18 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Acquiring lock "cinder-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Lock "cinder-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Acquiring lock "cinder-quobyte-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Lock "cinder-quobyte-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c26af6c-9dd0-4a28-9210-057162885fed]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:18 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.296s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:18 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Deleted volume successfully. Jul 16 11:20:18 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd Jul 16 11:20:18 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-bc647207-4924-403b-9cff-120924a67cda tempest-CinderUnicodeTest-651707819 None] Lock "cinder-e42035fb-f961-4327-b078-318cd2509a6a-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:18 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096" returned: 0 in 0.451s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:18 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 is being set with open permissions: ugo+rw Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:18 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 Jul 16 11:20:18 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:18 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd" returned: 0 in 0.441s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:18 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd Jul 16 11:20:18 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:18 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096" returned: 0 in 0.296s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:18 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.info Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-9361770e-ac5d-4dc8-b89e-44bde5706b69-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:18 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:18 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-9361770e-ac5d-4dc8-b89e-44bde5706b69-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-9361770e-ac5d-4dc8-b89e-44bde5706b69" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-9361770e-ac5d-4dc8-b89e-44bde5706b69" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:19 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd" returned: 0 in 0.387s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Lock "cinder-quobyte-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd" released by "delete_volume" :: held 0.868s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b184669f-7bb1-40d6-8d0a-404a94db7698]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Created reservations ['a5594735-599a-4c95-ace6-3edd0bfcdba2', 'd8d81077-6d94-42ab-9c58-86f780678a26', 'e7f0ec90-58db-4531-a2f6-8ccd71d5f5f0', 'f23b1003-f55a-495b-bc52-0bd3079f4b79'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:19 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.info" returned: 0 in 0.316s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:19 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.info is being set with open permissions: ugo+rw Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:19 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 Jul 16 11:20:19 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:19 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.info Jul 16 11:20:19 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:19 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:19 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:19 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.info" returned: 0 in 0.364s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.587s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:19 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.310s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:19 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Deleted volume successfully. Jul 16 11:20:19 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69" returned: 0 in 0.542s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-e44c8d30-a6ea-4ecf-ba90-fa16161a21a7 tempest-CinderUnicodeTest-651707819 None] Lock "cinder-f487e1a0-264c-4bd7-9e26-c3b19f6f53fd-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:19 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-fb56a48f-2648-4053-8ddf-88c96bb807bf tempest-ProjectMemberTests-1725097689 None] Create snapshot completed successfully Jul 16 11:20:19 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69 Jul 16 11:20:19 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:19 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-9361770e-ac5d-4dc8-b89e-44bde5706b69" returned: 0 in 0.258s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-9361770e-ac5d-4dc8-b89e-44bde5706b69" released by "delete_volume" :: held 0.876s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:19 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Created reservations ['d1334c74-82f9-4da9-a616-8854ea479797', 'a5ddada4-570e-4f06-b4d3-f6828ff7beb0', '85802363-c3b6-4211-bfb3-09c197e90634', '78a789e9-fb76-4f4f-9b1e-1b6f6082642c'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:20 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:20 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-53002c8c-57df-41ca-ac08-db74d6359096-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-53002c8c-57df-41ca-ac08-db74d6359096-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-f469c54a-9f92-4a01-b23f-8a8b4b50421f" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-f469c54a-9f92-4a01-b23f-8a8b4b50421f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-53002c8c-57df-41ca-ac08-db74d6359096" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-53002c8c-57df-41ca-ac08-db74d6359096" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Deleting offline snapshot 53002c8c-57df-41ca-ac08-db74d6359096 of volume f469c54a-9f92-4a01-b23f-8a8b4b50421f {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] snapshot_file for this snap is: volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fea98e-8c38-4657-aac3-d008befaa8cf]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:20 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.342s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Deleted volume successfully. Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-dc19e1f0-c7ab-4d96-8f3c-1b7111446741 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-9361770e-ac5d-4dc8-b89e-44bde5706b69-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:20 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 Jul 16 11:20:20 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:20 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096" returned: 0 in 0.509s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae42155-9f3c-4319-8995-4015dea7fa7a]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Flow 'volume_create_manager' (8f36c972-1287-4961-8b4d-8da176a80c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4ff3a4-8f5d-4e19-a816-eeaf7d4f40c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4ff3a4-8f5d-4e19-a816-eeaf7d4f40c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160094879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae612403-7b9c-4225-a9dc-fb9ad9998577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb908d6341a42eb8491375d7757b663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:21Z,use_quota=True,user_id='7de404e019c446fcbe11cff520ddb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c3221d-03e5-4383-af76-37f37e982d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c3221d-03e5-4383-af76-37f37e982d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b2ad38-e44b-4450-ac98-289cb4d1ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b2ad38-e44b-4450-ac98-289cb4d1ea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae612403-7b9c-4225-a9dc-fb9ad9998577', 'volume_name': 'volume-ae612403-7b9c-4225-a9dc-fb9ad9998577', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b6f6c5-aed9-4dc6-a37a-ef43e9524b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b6f6c5-aed9-4dc6-a37a-ef43e9524b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae574807-7f33-45e4-81c8-70b19ff0002a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:21 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Volume ae612403-7b9c-4225-a9dc-fb9ad9998577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae612403-7b9c-4225-a9dc-fb9ad9998577', 'volume_size': 1} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:21 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f Jul 16 11:20:21 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160094879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae612403-7b9c-4225-a9dc-fb9ad9998577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb908d6341a42eb8491375d7757b663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:21Z,use_quota=True,user_id='7de404e019c446fcbe11cff520ddb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Creating volume ae612403-7b9c-4225-a9dc-fb9ad9998577 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:21 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:21 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 1073741824 Jul 16 11:20:21 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:21 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f" returned: 0 in 0.480s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:21 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 Jul 16 11:20:21 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:21 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 1073741824" returned: 0 in 0.546s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:21 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 Jul 16 11:20:21 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:22 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096" returned: 0 in 0.619s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:22 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096 Jul 16 11:20:22 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:22 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577" returned: 0 in 0.417s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae574807-7f33-45e4-81c8-70b19ff0002a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae612403-7b9c-4225-a9dc-fb9ad9998577', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6787a6-a808-4732-b6cd-77f1a78e20ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:22 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Volume volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 (ae612403-7b9c-4225-a9dc-fb9ad9998577): created successfully Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6787a6-a808-4732-b6cd-77f1a78e20ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Flow 'volume_create_manager' (8f36c972-1287-4961-8b4d-8da176a80c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:22 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d4fa73de-faf5-4100-93ea-0909f409bdaf tempest-ProjectReaderTests-2042638655 None] Created volume successfully. Jul 16 11:20:22 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f.53002c8c-57df-41ca-ac08-db74d6359096" returned: 0 in 0.392s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-53002c8c-57df-41ca-ac08-db74d6359096" released by "_delete_snapshot" :: held 2.153s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-f469c54a-9f92-4a01-b23f-8a8b4b50421f" released by "delete_snapshot" :: held 2.191s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Created reservations ['692ce50b-f363-4cdb-ac89-cf5a7265720c', '7a5fa9d9-ebbf-4f37-ac96-62c47b9d6f6c', 'b038dda4-b6aa-4e6b-ba5d-e21db0ea2eb1', '8c227c5f-182b-4194-be7e-5814c7f43940'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:22 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Delete snapshot completed successfully. Jul 16 11:20:22 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a173f1e-d04c-478a-9d82-b45bb0f20ab0 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-53002c8c-57df-41ca-ac08-db74d6359096-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] Creating offline snapshot f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 of volume ae612403-7b9c-4225-a9dc-fb9ad9998577 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f3e621-411c-4e7e-9751-a7c82c324c5d]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:23 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 Jul 16 11:20:23 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-f469c54a-9f92-4a01-b23f-8a8b4b50421f-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-f469c54a-9f92-4a01-b23f-8a8b4b50421f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-f469c54a-9f92-4a01-b23f-8a8b4b50421f" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-f469c54a-9f92-4a01-b23f-8a8b4b50421f" acquired by "delete_volume" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52874e7-2521-4e8f-8d9e-4e01d4044bf0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-ca93c6c2-2bda-4bdd-bd02-115f6dda248e tempest-ProjectAdminTests-1600008248 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87345) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 16 11:20:23 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f Jul 16 11:20:23 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:23 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577" returned: 0 in 0.557s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:23 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 1G Jul 16 11:20:23 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:24 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f" returned: 0 in 0.417s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:24 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f Jul 16 11:20:24 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:24 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 1G" returned: 0 in 0.576s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:24 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f469c54a-9f92-4a01-b23f-8a8b4b50421f" returned: 0 in 0.372s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:24 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 Jul 16 11:20:24 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-f469c54a-9f92-4a01-b23f-8a8b4b50421f" released by "delete_volume" :: held 0.895s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Created reservations ['d8f64835-a89c-425c-9129-dee2df3760c1', '66a86345-c526-4ab1-8672-95587d5975d5', '2b9e6839-9488-4795-9973-c3d2a152f0cd', 'e113cac3-6ba3-4a57-b2d9-5a71af79a97e'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:24 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:24 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:24 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6" returned: 0 in 0.568s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:25 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 is being set with open permissions: ugo+rw Jul 16 11:20:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:25 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 Jul 16 11:20:25 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:25 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.396s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:25 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:25 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Deleted volume successfully. Jul 16 11:20:25 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-168d8a72-0377-4d88-9f7f-e9f08f06f002 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-f469c54a-9f92-4a01-b23f-8a8b4b50421f-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:25 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6" returned: 0 in 0.346s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:25 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.info Jul 16 11:20:25 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:25 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.info" returned: 0 in 0.274s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:25 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.info is being set with open permissions: ugo+rw Jul 16 11:20:25 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:25 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.info Jul 16 11:20:25 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:26 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.info" returned: 0 in 0.399s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.830s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:26 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-44585855-7c33-4cfc-97dc-e641a0882c3e tempest-ProjectReaderTests-2042638655 None] Create snapshot completed successfully Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (a2798b7e-e037-4778-a63e-73268110980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e167bfd0-6afb-401c-846e-0a86f7ae4486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e167bfd0-6afb-401c-846e-0a86f7ae4486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-358984707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:26Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c37f31-71f1-4148-a9e8-e0b0a5a8e52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c37f31-71f1-4148-a9e8-e0b0a5a8e52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04526ccb-0d01-4937-bb29-1c6c730dff64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04526ccb-0d01-4937-bb29-1c6c730dff64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d', 'volume_name': 'volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee936b59-37de-4af5-9034-56e657252e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee936b59-37de-4af5-9034-56e657252e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ec1bee-6649-46ef-8b90-f72a69ff95ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:26 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Volume 6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d', 'volume_size': 1} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-358984707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:26Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Creating volume 6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:26 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-ae612403-7b9c-4225-a9dc-fb9ad9998577" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:26 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d 1073741824 Jul 16 11:20:26 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-ae612403-7b9c-4225-a9dc-fb9ad9998577" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Deleting offline snapshot f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 of volume ae612403-7b9c-4225-a9dc-fb9ad9998577 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] snapshot_file for this snap is: volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce2c554-13d2-4bdf-9109-67bdd9e94fc7]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:26 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 Jul 16 11:20:26 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:26 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:26 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d 1073741824" returned: 0 in 0.531s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:27 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6" returned: 0 in 0.477s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae612403-7b9c-4225-a9dc-fb9ad9998577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:27 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d Jul 16 11:20:27 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eac0a6-5e0d-4db3-94f4-9cce57e9a3c0]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:27 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 Jul 16 11:20:27 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:27 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d" returned: 0 in 0.296s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ec1bee-6649-46ef-8b90-f72a69ff95ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb377034-c5a0-4c6b-9f3b-07a6a77c1e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:27 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Volume volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d (6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d): created successfully Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb377034-c5a0-4c6b-9f3b-07a6a77c1e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (a2798b7e-e037-4778-a63e-73268110980c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:27 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-cfa99ba0-95ca-4991-be75-e9ded8c42e40 tempest-ProjectMemberTests-1725097689 None] Created volume successfully. Jul 16 11:20:27 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577" returned: 0 in 0.530s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:27 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 Jul 16 11:20:27 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:28 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6" returned: 0 in 0.461s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:28 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6 Jul 16 11:20:28 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:28 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577.f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6" returned: 0 in 0.423s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6" released by "_delete_snapshot" :: held 2.042s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-ae612403-7b9c-4225-a9dc-fb9ad9998577" released by "delete_snapshot" :: held 2.073s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Created reservations ['2019d583-1f45-4f97-b1a2-bf251c082db8', '6e43bcd1-abad-4a82-8607-b46550fe059a', '2ceb001f-93d7-4405-9c24-5e1ba60e7553', '2c62f293-c583-4ad9-8f48-9daf79abf906'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Delete snapshot completed successfully. Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-976e4a86-4b78-4b86-a076-8a54336ad9b6 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-f7409c8b-2ad0-4f5b-8372-565b2ec5e0c6-delete_snapshot" released by "delete_snapshot" :: held 2.445s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] Creating offline snapshot 243106a0-6fb3-4a08-bebf-6bfe12221ee9 of volume 6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f10efa5-5a05-45be-856e-240942365e16]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:29 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d Jul 16 11:20:29 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:29 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d" returned: 0 in 0.539s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:29 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 1G Jul 16 11:20:29 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-ae612403-7b9c-4225-a9dc-fb9ad9998577-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-ae612403-7b9c-4225-a9dc-fb9ad9998577-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-ae612403-7b9c-4225-a9dc-fb9ad9998577" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-ae612403-7b9c-4225-a9dc-fb9ad9998577" acquired by "delete_volume" :: waited 0.034s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:29 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[04845a9f-8bef-46a2-a141-743aec262143]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:30 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 1G" returned: 0 in 0.508s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:30 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 Jul 16 11:20:30 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:30 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 Jul 16 11:20:30 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Flow 'volume_create_manager' (21b9295a-e537-4692-af7f-744831261ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15483d9-a51a-4f03-a2e7-1c69df167331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15483d9-a51a-4f03-a2e7-1c69df167331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1613294214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035c311aff6f4a4e8bfb8ebb34c11e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:30Z,use_quota=True,user_id='3c389dea85a9489990b0a798e7b66860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4f697d-595a-41c7-8613-a22493908a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4f697d-595a-41c7-8613-a22493908a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e3fad1-c87a-46f3-aa96-8d19380c4442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e3fad1-c87a-46f3-aa96-8d19380c4442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad', 'volume_name': 'volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:30 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d954007-3b73-4b50-8a0c-5105cb404233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d954007-3b73-4b50-8a0c-5105cb404233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c769e6e5-ac65-47f0-8378-ce6b7b83b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:30 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Volume 8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad', 'volume_size': 1} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577" returned: 0 in 0.421s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:30 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9" returned: 0 in 0.352s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:30 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 is being set with open permissions: ugo+rw Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:30 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577 Jul 16 11:20:30 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:30 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 Jul 16 11:20:30 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:30 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-ae612403-7b9c-4225-a9dc-fb9ad9998577" returned: 0 in 0.257s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:30 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-ae612403-7b9c-4225-a9dc-fb9ad9998577" released by "delete_volume" :: held 0.752s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:30 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.info Jul 16 11:20:30 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Created reservations ['c961d202-33bf-4393-9658-56d70adb9377', '9d3e974b-0934-4417-b034-099f176ded20', 'def2ffcc-fbbc-4486-ba2b-3916b5adc53e', '6faf4cdb-bf76-4caa-a33e-c71553a4ae30'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:30 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:30 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:30 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.info" returned: 0 in 0.298s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:30 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.info is being set with open permissions: ugo+rw Jul 16 11:20:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:30 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.info Jul 16 11:20:30 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:31 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.282s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:31 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Deleted volume successfully. Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-8c0f82b3-6117-4274-ae49-9c0c0f829928 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-ae612403-7b9c-4225-a9dc-fb9ad9998577-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:31 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.info" returned: 0 in 0.293s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1613294214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035c311aff6f4a4e8bfb8ebb34c11e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:30Z,use_quota=True,user_id='3c389dea85a9489990b0a798e7b66860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Creating volume 8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:31 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:31 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad 1073741824 Jul 16 11:20:31 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:31 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-aab10e19-9101-4bfc-a2e3-074fc4f153e6 tempest-ProjectMemberTests-1725097689 None] Create snapshot completed successfully Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Flow 'volume_create_manager' (39c3e739-03d6-45a4-818d-614150da411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a08420-c254-4114-b650-b7022406ea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a08420-c254-4114-b650-b7022406ea6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597167152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca4d9e2-8f74-4fa9-ab5f-a647884b2422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb908d6341a42eb8491375d7757b663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:32Z,use_quota=True,user_id='7de404e019c446fcbe11cff520ddb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afd9931-f25e-45c3-b211-fe993d1fee75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6afd9931-f25e-45c3-b211-fe993d1fee75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cbc98b-2fd3-40f5-b665-dcdfa46eaf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cbc98b-2fd3-40f5-b665-dcdfa46eaf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca4d9e2-8f74-4fa9-ab5f-a647884b2422', 'volume_name': 'volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97869eaa-bc1e-4aa5-9fa2-f1de437752aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97869eaa-bc1e-4aa5-9fa2-f1de437752aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b97415b-1999-443f-a8ef-c7968011b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:31 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Volume 2ca4d9e2-8f74-4fa9-ab5f-a647884b2422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422', 'volume_size': 1} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:31 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad 1073741824" returned: 0 in 0.502s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:31 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad Jul 16 11:20:31 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-243106a0-6fb3-4a08-bebf-6bfe12221ee9-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:32 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Lock "cinder-243106a0-6fb3-4a08-bebf-6bfe12221ee9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" returned: 0 in 0.251s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1597167152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca4d9e2-8f74-4fa9-ab5f-a647884b2422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb908d6341a42eb8491375d7757b663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:32Z,use_quota=True,user_id='7de404e019c446fcbe11cff520ddb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Creating volume 2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:32 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-243106a0-6fb3-4a08-bebf-6bfe12221ee9" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:32 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 1073741824 Jul 16 11:20:32 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c769e6e5-ac65-47f0-8378-ce6b7b83b51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd797a8a-4ea8-4154-8a7e-7320053b42f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-243106a0-6fb3-4a08-bebf-6bfe12221ee9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Deleting offline snapshot 243106a0-6fb3-4a08-bebf-6bfe12221ee9 of volume 6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] snapshot_file for this snap is: volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:32 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Volume volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad (8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad): created successfully Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd797a8a-4ea8-4154-8a7e-7320053b42f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Flow 'volume_create_manager' (21b9295a-e537-4692-af7f-744831261ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be924ff-0238-403b-8f5a-f044979ae508]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:32 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-447508f0-fe0a-4736-a6fc-c2487255978f tempest-SnapshotDependencyTests-696841875 None] Created volume successfully. Jul 16 11:20:32 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 Jul 16 11:20:32 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:32 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 1073741824" returned: 0 in 0.447s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:32 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9" returned: 0 in 0.427s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:32 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 Jul 16 11:20:32 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4bbe76-4458-4b95-8a83-a586d8d40397]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:32 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d Jul 16 11:20:32 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:32 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422" returned: 0 in 0.314s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.095s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b97415b-1999-443f-a8ef-c7968011b48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d1cd09-1f5f-4b53-95a1-36bc718e1ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] Creating offline snapshot 33c28c49-4f05-41f3-8293-30c5f628d9a5 of volume 8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:20:32 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Volume volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 (2ca4d9e2-8f74-4fa9-ab5f-a647884b2422): created successfully Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d1cd09-1f5f-4b53-95a1-36bc718e1ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Flow 'volume_create_manager' (39c3e739-03d6-45a4-818d-614150da411d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e780581-8810-46a5-ac08-e69052c10494]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:33 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9fc4193a-76ab-46ae-84a1-500399bedf09 tempest-ProjectReaderTests-2042638655 None] Created volume successfully. Jul 16 11:20:33 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad Jul 16 11:20:33 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:33 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d" returned: 0 in 0.465s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:33 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 Jul 16 11:20:33 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:33 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" returned: 0 in 0.400s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:33 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 1G Jul 16 11:20:33 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:33 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9" returned: 0 in 0.392s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:33 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9 Jul 16 11:20:33 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:33 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d.243106a0-6fb3-4a08-bebf-6bfe12221ee9" returned: 0 in 0.307s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:33 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-243106a0-6fb3-4a08-bebf-6bfe12221ee9" released by "_delete_snapshot" :: held 1.729s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 1G" returned: 0 in 0.499s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d" released by "delete_snapshot" :: held 1.774s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:33 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 Jul 16 11:20:33 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:33 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Created reservations ['f1b86a7e-df5a-4686-9cd6-deaacf5c31ae', '25523e94-105d-4f61-8c3d-aff7886bd515', '35b18d3e-bd07-4137-b9a0-cea7c8ea6932', '615a4240-6426-4695-9213-7ce57c7648d8'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Delete snapshot completed successfully. Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-2a1bfd7c-0a2c-46a3-a483-1a49f2b2629c tempest-ProjectMemberTests-1725097689 None] Lock "cinder-243106a0-6fb3-4a08-bebf-6bfe12221ee9-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:34 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5" returned: 0 in 0.297s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:34 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 is being set with open permissions: ugo+rw Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:34 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 Jul 16 11:20:34 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d606a52-a3d3-478c-8865-989f8596ba68]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:34 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5" returned: 0 in 0.254s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:34 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d Jul 16 11:20:34 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:34 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.info Jul 16 11:20:34 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:34 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:34 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:34 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d" returned: 0 in 0.397s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:34 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d Jul 16 11:20:34 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:34 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.info" returned: 0 in 0.314s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:34 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.info is being set with open permissions: ugo+rw Jul 16 11:20:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:34 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.info Jul 16 11:20:34 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:35 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.325s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:20:35 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d" returned: 0 in 0.314s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d" released by "delete_volume" :: held 0.768s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:35 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.info" returned: 0 in 0.285s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.208s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] Creating offline snapshot 6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f of volume 2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:20:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-0a9394a8-e41e-4e87-9102-de9efaabcff0 tempest-SnapshotDependencyTests-696841875 None] Create snapshot completed successfully Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[033385cc-f7ad-49cc-b7f3-e222f5ff4393]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Created reservations ['43b89df8-3d3d-41e5-983f-29b4531c7fc2', '2d0982d7-2c4a-4fb1-b69c-a71ba9f5e1e4', '291f0a87-26be-4483-a3b0-f32a28239541', '7b2cecec-7ba3-4617-9dc3-0c89f55a9a9c'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:35 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 Jul 16 11:20:35 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:35 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:35 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:35 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.284s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:35 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Deleted volume successfully. Jul 16 11:20:35 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422" returned: 0 in 0.439s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:35 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-47d35e7f-ebc6-452d-b940-4f958b445986 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-6e0a3eaf-97f5-4d5e-9b41-cc5569fb984d-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:35 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f 1G Jul 16 11:20:35 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (a8bd26fb-6600-4bab-975d-659c87f751d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268c8c3f-76ff-40fd-85b2-bc632ba30ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268c8c3f-76ff-40fd-85b2-bc632ba30ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904416861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1928fa-c474-4c7b-8305-006cc83b074b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:36Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9f4bc3-e51c-4f62-92ba-205fb92a46b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9f4bc3-e51c-4f62-92ba-205fb92a46b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d929131-ab3a-4111-859a-99f9040896ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d929131-ab3a-4111-859a-99f9040896ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b1928fa-c474-4c7b-8305-006cc83b074b', 'volume_name': 'volume-0b1928fa-c474-4c7b-8305-006cc83b074b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ef13bd-afa2-48a1-9645-26353221c1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ef13bd-afa2-48a1-9645-26353221c1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8daeffd6-adee-418a-b8ad-534a71d14087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:36 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Volume 0b1928fa-c474-4c7b-8305-006cc83b074b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b1928fa-c474-4c7b-8305-006cc83b074b', 'volume_size': 1} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:36 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f 1G" returned: 0 in 0.549s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:36 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f Jul 16 11:20:36 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:36 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f" returned: 0 in 0.391s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:36 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f is being set with open permissions: ugo+rw Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:36 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f Jul 16 11:20:36 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:36 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Flow 'volume_create_manager' (a94c0dc9-77a0-4278-af99-d88d366a7b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d35e602-d5c3-432b-9fbe-fd1989b16b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f" returned: 0 in 0.302s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d35e602-d5c3-432b-9fbe-fd1989b16b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ccbb55-d237-4fdc-bc73-e9c2d8837c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035c311aff6f4a4e8bfb8ebb34c11e44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33c28c49-4f05-41f3-8293-30c5f628d9a5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:37Z,use_quota=True,user_id='3c389dea85a9489990b0a798e7b66860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6796b11f-e063-40ec-8c63-573dbc1bc4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6796b11f-e063-40ec-8c63-573dbc1bc4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c66ff6d-8668-4977-8563-432706edd79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c66ff6d-8668-4977-8563-432706edd79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '80ccbb55-d237-4fdc-bc73-e9c2d8837c36', 'volume_name': 'volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36', 'volume_size': 1, 'snapshot_id': '33c28c49-4f05-41f3-8293-30c5f628d9a5'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7698f0b3-1685-401e-a853-5a5a299626a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7698f0b3-1685-401e-a853-5a5a299626a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e35fa1a-9fd1-4d47-a3ba-1a5f997ce937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:36 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Volume 80ccbb55-d237-4fdc-bc73-e9c2d8837c36: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36', 'volume_size': 1, 'snapshot_id': '33c28c49-4f05-41f3-8293-30c5f628d9a5'} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:36 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.info Jul 16 11:20:36 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:37 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.info" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:37 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.info is being set with open permissions: ugo+rw Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:37 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.info Jul 16 11:20:37 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:37 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.info" returned: 0 in 0.248s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904416861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1928fa-c474-4c7b-8305-006cc83b074b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:36Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Creating volume 0b1928fa-c474-4c7b-8305-006cc83b074b {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:37 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:37 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b 1073741824 Jul 16 11:20:37 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:37 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-ff004514-cff7-4b39-ba7e-6c97525c3810 tempest-ProjectReaderTests-2042638655 None] Create snapshot completed successfully Jul 16 11:20:37 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b 1073741824" returned: 0 in 0.453s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:37 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b Jul 16 11:20:37 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Lock "cinder-6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Deleting offline snapshot 6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f of volume 2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:38 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] snapshot_file for this snap is: volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b" returned: 0 in 0.282s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.296s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "cinder-quobyte-33c28c49-4f05-41f3-8293-30c5f628d9a5-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" by "_create_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5743c0-1220-4f24-813e-fb78363b6b83]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8daeffd6-adee-418a-b8ad-534a71d14087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1928fa-c474-4c7b-8305-006cc83b074b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9a71a2-c36f-4bae-99b2-5db4d5f86899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-33c28c49-4f05-41f3-8293-30c5f628d9a5-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Creating volume 80ccbb55-d237-4fdc-bc73-e9c2d8837c36 from snapshot 33c28c49-4f05-41f3-8293-30c5f628d9a5 {{(pid=87345) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "cinder-quobyte-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" by "_copy_volume_from_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:38 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Volume volume-0b1928fa-c474-4c7b-8305-006cc83b074b (0b1928fa-c474-4c7b-8305-006cc83b074b): created successfully Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9a71a2-c36f-4bae-99b2-5db4d5f86899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (a8bd26fb-6600-4bab-975d-659c87f751d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] snapshot: 33c28c49-4f05-41f3-8293-30c5f628d9a5, volume: 80ccbb55-d237-4fdc-bc73-e9c2d8837c36, {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 11:20:38 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7c9a07e7-33c2-48b9-b226-a3ae73117ed4 tempest-ProjectMemberTests-1725097689 None] Created volume successfully. Jul 16 11:20:38 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f Jul 16 11:20:38 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ff374d-82c0-4a1f-af64-4f8f062dae48]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:38 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 Jul 16 11:20:38 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:38 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f" returned: 0 in 0.414s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[b996bed8-d1f3-4322-9c4f-68782e5b2ca6]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:38 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5" returned: 0 in 0.398s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Creating direct copy from snapshot {{(pid=87345) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6c47be-83a3-4c0b-b230-ec36aa28d390]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:38 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:38 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 Jul 16 11:20:38 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:38 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad Jul 16 11:20:38 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:39 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422" returned: 0 in 0.426s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:39 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f Jul 16 11:20:39 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:39 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" returned: 0 in 0.468s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:39 devstack cinder-volume[87345]: DEBUG cinder.utils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Path /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 not found in is_blk_device check {{(pid=87345) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 11:20:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:39 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 Jul 16 11:20:39 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:39 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f" returned: 0 in 0.478s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:39 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f Jul 16 11:20:39 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:39 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:39 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422.6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f" returned: 0 in 0.337s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:39 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f" released by "_delete_snapshot" :: held 1.821s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422" released by "delete_snapshot" :: held 1.859s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:40 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Created reservations ['88c6e834-5f1b-4b0e-afc4-09f284722a0d', '9f79edd7-81e4-4135-84cc-9569b5cf7989', 'f484566c-141c-4703-ad65-b3b439329e47', '8bbd9763-9f10-49c8-84f8-187d8f0d1a5e'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:40 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Delete snapshot completed successfully. Jul 16 11:20:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-56b61b3d-906f-473c-945a-3ff865f0b29d tempest-ProjectReaderTests-2042638655 None] Lock "cinder-6cb8cb96-fb93-4dd1-88ea-a1bb66ca653f-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:40 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422" acquired by "delete_volume" :: waited 0.055s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:40 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d9e976-a277-4a6f-8612-66719a53cf8e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:40 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:41 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 Jul 16 11:20:41 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:41 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422" returned: 0 in 0.956s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:41 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:41 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422 Jul 16 11:20:41 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:42 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:42 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422" returned: 0 in 0.739s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:42 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422" released by "delete_volume" :: held 1.864s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:42 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Created reservations ['8e122c52-fc6f-4fa1-acce-f6b1d5873b3c', 'bd47851e-ba84-4277-bee5-53c1fd2b907f', 'c04191f3-1fd1-4b00-b4b9-a3e3cca4cf2b', 'b744e7e0-8384-414e-b7b0-f0010e0157af'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:43 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:43 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:43 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:43 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:43 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.513s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:43 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:43 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Deleted volume successfully. Jul 16 11:20:43 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5365b7fc-d2e9-430b-a6cc-45a6e48bca43 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-2ca4d9e2-8f74-4fa9-ab5f-a647884b2422-delete_volume" released by "delete_volume" :: held 3.159s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Flow 'volume_create_manager' (341d0f0b-6b96-4bb4-a4bc-5940b68359be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e921f84f-918f-4c4e-983d-5b30d0c1f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e921f84f-918f-4c4e-983d-5b30d0c1f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98896439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba8c06f-02d5-45eb-a8e4-fe72d13d874b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb908d6341a42eb8491375d7757b663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:44Z,use_quota=True,user_id='7de404e019c446fcbe11cff520ddb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2af229a-e4c5-4963-9ff1-e86eacf50306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2af229a-e4c5-4963-9ff1-e86eacf50306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31409503-20fd-4d24-8d0b-109feb56e8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31409503-20fd-4d24-8d0b-109feb56e8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba8c06f-02d5-45eb-a8e4-fe72d13d874b', 'volume_name': 'volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997a87df-1801-48f2-9372-2dc5108b7ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997a87df-1801-48f2-9372-2dc5108b7ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a882eb70-27d1-4dbe-ae73-e63aa4a7d670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:44 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Volume 5ba8c06f-02d5-45eb-a8e4-fe72d13d874b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b', 'volume_size': 1} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:44 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" returned: 0 in 5.482s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5247b7-7ce4-4947-afc2-0771f1a0e136]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:44 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:44 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad Jul 16 11:20:44 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:45 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" returned: 0 in 0.530s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.image.image_utils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Image conversion details: src /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 {{(pid=87345) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 11:20:45 devstack cinder-volume[87345]: INFO cinder.image.image_utils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Converted 1024.00 MB image at 186.75 MB/s Jul 16 11:20:45 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 is being set with open permissions: ugo+rw Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:45 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 Jul 16 11:20:45 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:45 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" returned: 0 in 0.239s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" released by "_copy_volume_from_snapshot" :: held 7.219s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-33c28c49-4f05-41f3-8293-30c5f628d9a5-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" released by "_create_volume_from_snapshot" :: held 7.272s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.326s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.218s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] Creating offline snapshot 39504f9f-9ac9-4991-a78e-7af4953d700e of volume 0b1928fa-c474-4c7b-8305-006cc83b074b {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e35fa1a-9fd1-4d47-a3ba-1a5f997ce937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36', 'volume_size': 1, 'snapshot_id': '33c28c49-4f05-41f3-8293-30c5f628d9a5'}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f70ee29-01b4-4037-8a64-5942533b80eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bbe616-2045-42d8-ba95-ac2150d4fc08]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:45 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Volume volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 (80ccbb55-d237-4fdc-bc73-e9c2d8837c36): created successfully Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f70ee29-01b4-4037-8a64-5942533b80eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Flow 'volume_create_manager' (a94c0dc9-77a0-4278-af99-d88d366a7b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:45 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-652bccb5-861b-4fee-a22c-eb16b35c0ac8 tempest-SnapshotDependencyTests-696841875 None] Created volume successfully. Jul 16 11:20:45 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b Jul 16 11:20:45 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "cinder-33c28c49-4f05-41f3-8293-30c5f628d9a5-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-33c28c49-4f05-41f3-8293-30c5f628d9a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "cinder-quobyte-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "cinder-quobyte-33c28c49-4f05-41f3-8293-30c5f628d9a5" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-33c28c49-4f05-41f3-8293-30c5f628d9a5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Deleting offline snapshot 33c28c49-4f05-41f3-8293-30c5f628d9a5 of volume 8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] snapshot_file for this snap is: volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2a2da7-27db-45b5-95ff-268d6d303544]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:45 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:46 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b" returned: 0 in 0.427s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:46 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e 1G Jul 16 11:20:46 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:46 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 Jul 16 11:20:46 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:46 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5" returned: 0 in 0.388s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d3957f-6795-419b-a6df-2b1e12a86718]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:46 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad Jul 16 11:20:46 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:46 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e 1G" returned: 0 in 0.491s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1928fa-c474-4c7b-8305-006cc83b074b -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:46 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1928fa-c474-4c7b-8305-006cc83b074b -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e Jul 16 11:20:46 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:46 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" returned: 0 in 0.465s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:46 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 Jul 16 11:20:46 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:46 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1928fa-c474-4c7b-8305-006cc83b074b -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e" returned: 0 in 0.352s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:46 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e is being set with open permissions: ugo+rw Jul 16 11:20:46 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:46 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e Jul 16 11:20:46 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:47 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e" returned: 0 in 0.259s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:47 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.info Jul 16 11:20:47 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:47 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5" returned: 0 in 0.386s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:47 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5 Jul 16 11:20:47 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:47 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.info" returned: 0 in 0.280s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:47 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.info is being set with open permissions: ugo+rw Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:47 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.info Jul 16 11:20:47 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:47 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad.33c28c49-4f05-41f3-8293-30c5f628d9a5" returned: 0 in 0.284s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-33c28c49-4f05-41f3-8293-30c5f628d9a5" released by "_delete_snapshot" :: held 1.632s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" released by "delete_snapshot" :: held 1.662s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Created reservations ['f9b4fb8e-2896-4f06-b478-7bb3aba9fe59', '412a79f4-b3b1-4222-81c6-73578d29cff7', 'bbb714b4-11c2-426e-95f0-a120b67ab368', '695b22cc-e034-4991-b2f2-b5ddc9ae8bd1'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:47 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Delete snapshot completed successfully. Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-04dc7aa8-fa30-46db-a91e-7c618f680f8b tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-33c28c49-4f05-41f3-8293-30c5f628d9a5-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:47 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.info" returned: 0 in 0.279s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.201s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98896439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba8c06f-02d5-45eb-a8e4-fe72d13d874b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb908d6341a42eb8491375d7757b663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:44Z,use_quota=True,user_id='7de404e019c446fcbe11cff520ddb227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Creating volume 5ba8c06f-02d5-45eb-a8e4-fe72d13d874b {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:47 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:47 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:47 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b 1073741824 Jul 16 11:20:47 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:47 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-2e1a221d-1c47-482b-a9c6-20b4079fc027 tempest-ProjectMemberTests-1725097689 None] Create snapshot completed successfully Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "cinder-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "cinder-quobyte-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" acquired by "delete_volume" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a618f8-4a45-4f76-bac1-8bdca41f54b2]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:48 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b 1073741824" returned: 0 in 0.494s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:48 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad Jul 16 11:20:48 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:48 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b Jul 16 11:20:48 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:48 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b" returned: 0 in 0.294s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:48 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" returned: 0 in 0.443s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a882eb70-27d1-4dbe-ae73-e63aa4a7d670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325d09ea-e58a-4d00-b101-bc86237e10e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:48 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad Jul 16 11:20:48 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:48 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Volume volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b (5ba8c06f-02d5-45eb-a8e4-fe72d13d874b): created successfully Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325d09ea-e58a-4d00-b101-bc86237e10e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Flow 'volume_create_manager' (341d0f0b-6b96-4bb4-a4bc-5940b68359be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:48 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7f73df54-64f6-4625-8e19-8117ca1b3247 tempest-ProjectReaderTests-2042638655 None] Created volume successfully. Jul 16 11:20:48 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" returned: 0 in 0.278s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad" released by "delete_volume" :: held 0.790s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-39504f9f-9ac9-4991-a78e-7af4953d700e-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Created reservations ['5c30316b-6243-4a93-a331-8bb47c3dc7f9', 'a8d3dd03-da99-4b31-92fc-b485d18bb6b5', '4c017ce6-bc40-4bc8-aa2e-f860572f2e42', '0936872c-a5ad-4537-a657-405f02a5c627'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-39504f9f-9ac9-4991-a78e-7af4953d700e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:48 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-0b1928fa-c474-4c7b-8305-006cc83b074b" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-0b1928fa-c474-4c7b-8305-006cc83b074b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-39504f9f-9ac9-4991-a78e-7af4953d700e" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-39504f9f-9ac9-4991-a78e-7af4953d700e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Deleting offline snapshot 39504f9f-9ac9-4991-a78e-7af4953d700e of volume 0b1928fa-c474-4c7b-8305-006cc83b074b {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] snapshot_file for this snap is: volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbd9052-831b-4d5e-a6ef-d6857901fdf4]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:49 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:49 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:49 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e Jul 16 11:20:49 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "cinder-80ccbb55-d237-4fdc-bc73-e9c2d8837c36-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-80ccbb55-d237-4fdc-bc73-e9c2d8837c36-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "cinder-quobyte-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[291d3600-d4cb-4d69-afd5-3ef8d347b8fc]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:49 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.312s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:49 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Deleted volume successfully. Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b6575ec4-e4da-45f8-8ccc-7a3cb3ea0c4b tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-8941e93f-af35-4a8c-85c8-8eb7b2f8e5ad-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:49 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 Jul 16 11:20:49 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:49 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e" returned: 0 in 0.466s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b1928fa-c474-4c7b-8305-006cc83b074b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[e468779e-f19c-4d80-9d1a-62fbe8bc98ad]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] Creating offline snapshot 252ad9e5-19b6-4068-9160-acd9d1832a29 of volume 5ba8c06f-02d5-45eb-a8e4-fe72d13d874b {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c979f634-cbf3-4f7d-ae4e-785ee0c1c9cf]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:49 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b Jul 16 11:20:49 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:49 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" returned: 0 in 0.407s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:49 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:49 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36 Jul 16 11:20:49 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:49 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b Jul 16 11:20:49 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:50 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b" returned: 0 in 0.421s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:50 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e Jul 16 11:20:50 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:50 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" returned: 0 in 0.264s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-quobyte-80ccbb55-d237-4fdc-bc73-e9c2d8837c36" released by "delete_volume" :: held 0.714s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:50 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b" returned: 0 in 0.373s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:50 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 1G Jul 16 11:20:50 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Created reservations ['1a329cf3-e20a-462d-87ee-9427f28f10a6', '8dd42108-7b35-4627-83e2-9493994b620e', '405d0e14-a741-4151-a294-fcf8649ae43e', '77f49596-7375-4100-8480-75fe69c92a09'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:50 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:50 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:50 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e" returned: 0 in 0.388s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:50 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e Jul 16 11:20:50 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:50 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.307s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:50 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 1G" returned: 0 in 0.441s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Deleted volume successfully. Jul 16 11:20:50 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 Jul 16 11:20:50 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-9f1071f3-092d-40e4-9af7-a831bd857c23 tempest-SnapshotDependencyTests-696841875 None] Lock "cinder-80ccbb55-d237-4fdc-bc73-e9c2d8837c36-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:50 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b.39504f9f-9ac9-4991-a78e-7af4953d700e" returned: 0 in 0.289s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-39504f9f-9ac9-4991-a78e-7af4953d700e" released by "_delete_snapshot" :: held 1.692s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-0b1928fa-c474-4c7b-8305-006cc83b074b" released by "delete_snapshot" :: held 1.724s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Created reservations ['9af9c484-0491-4d6d-8c8b-222e0fcf7c3b', '1f668990-d913-488b-912e-de51bb235cd5', '59e0d84a-d188-45ce-ba87-ccbcae339cac', '6b1bc13f-169b-410f-9858-cf8667d12832'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:50 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Delete snapshot completed successfully. Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-76c8b5df-38c7-4cb9-a907-c9522f797875 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-39504f9f-9ac9-4991-a78e-7af4953d700e-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:50 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29" returned: 0 in 0.346s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:50 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 is being set with open permissions: ugo+rw Jul 16 11:20:50 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:50 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 Jul 16 11:20:50 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:51 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-0b1928fa-c474-4c7b-8305-006cc83b074b-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29" returned: 0 in 0.262s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Lock "cinder-0b1928fa-c474-4c7b-8305-006cc83b074b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:51 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.info Jul 16 11:20:51 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-0b1928fa-c474-4c7b-8305-006cc83b074b" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-0b1928fa-c474-4c7b-8305-006cc83b074b" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6e7c45-301e-4dab-9947-f2bd196d3651]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:51 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b Jul 16 11:20:51 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:51 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.info" returned: 0 in 0.283s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:51 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.info is being set with open permissions: ugo+rw Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:51 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.info Jul 16 11:20:51 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:51 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b" returned: 0 in 0.412s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:51 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b Jul 16 11:20:51 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:51 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.info" returned: 0 in 0.308s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:51 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d4dd8284-e843-44e1-8903-c7d27a7b0d0a tempest-ProjectReaderTests-2042638655 None] Create snapshot completed successfully Jul 16 11:20:51 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0b1928fa-c474-4c7b-8305-006cc83b074b" returned: 0 in 0.260s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:51 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-0b1928fa-c474-4c7b-8305-006cc83b074b" released by "delete_volume" :: held 0.745s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Created reservations ['7bd4f465-7163-4027-b31c-6c4e31111288', '7f0ce3b8-c760-4dac-a57b-3b6f3cf97761', '7ab178c3-17f4-438b-a100-d9b14f311430', 'dd52b383-d543-486e-a5c9-a98a411a26bc'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:52 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:52 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:52 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.284s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:52 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Deleted volume successfully. Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b35cf75b-0884-4dfa-8dfd-6536ad9ed03e tempest-ProjectMemberTests-1725097689 None] Lock "cinder-0b1928fa-c474-4c7b-8305-006cc83b074b-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (b115b581-b5a0-4f76-b1e0-6d477a6f27f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c9cfbf-7167-4279-baff-11cb11ab8eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c9cfbf-7167-4279-baff-11cb11ab8eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720236377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b925fc-e35d-4f0d-8632-e032b992242f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:53Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1491b4-bca6-4f33-b88a-c727acda49ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1491b4-bca6-4f33-b88a-c727acda49ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2f72af-c599-47df-a57c-49eb048ef81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2f72af-c599-47df-a57c-49eb048ef81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4b925fc-e35d-4f0d-8632-e032b992242f', 'volume_name': 'volume-b4b925fc-e35d-4f0d-8632-e032b992242f', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea08fb7-fbee-41e1-b0ed-22864ec0f9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea08fb7-fbee-41e1-b0ed-22864ec0f9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96abfbf8-a66e-49b8-8ae4-9f7984ef8738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:52 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Volume b4b925fc-e35d-4f0d-8632-e032b992242f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4b925fc-e35d-4f0d-8632-e032b992242f', 'volume_size': 1} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720236377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b925fc-e35d-4f0d-8632-e032b992242f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:20:53Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Creating volume b4b925fc-e35d-4f0d-8632-e032b992242f {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:20:52 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-252ad9e5-19b6-4068-9160-acd9d1832a29-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-252ad9e5-19b6-4068-9160-acd9d1832a29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:52 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f 1073741824 Jul 16 11:20:52 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-252ad9e5-19b6-4068-9160-acd9d1832a29" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-252ad9e5-19b6-4068-9160-acd9d1832a29" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Deleting offline snapshot 252ad9e5-19b6-4068-9160-acd9d1832a29 of volume 5ba8c06f-02d5-45eb-a8e4-fe72d13d874b {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] snapshot_file for this snap is: volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:52 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbca4d5-b767-4764-b4b1-3ef871859737]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:53 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 Jul 16 11:20:53 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:53 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f 1073741824" returned: 0 in 0.489s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:53 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29" returned: 0 in 0.438s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:53 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f Jul 16 11:20:53 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecadf981-da79-4897-a5a0-bc8c8c4ceefb]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:53 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b Jul 16 11:20:53 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:53 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f" returned: 0 in 0.353s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96abfbf8-a66e-49b8-8ae4-9f7984ef8738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b925fc-e35d-4f0d-8632-e032b992242f', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7044dd5-d1f2-4232-a824-9faf2a5adf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:20:53 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Volume volume-b4b925fc-e35d-4f0d-8632-e032b992242f (b4b925fc-e35d-4f0d-8632-e032b992242f): created successfully Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7044dd5-d1f2-4232-a824-9faf2a5adf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:20:53 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (b115b581-b5a0-4f76-b1e0-6d477a6f27f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:20:53 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-043b4b49-f47d-4905-948b-469c798cd0af tempest-ProjectMemberTests-1725097689 None] Created volume successfully. Jul 16 11:20:54 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b" returned: 0 in 0.457s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:54 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 Jul 16 11:20:54 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:54 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29" returned: 0 in 0.374s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:54 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29 Jul 16 11:20:54 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:54 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:54 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b.252ad9e5-19b6-4068-9160-acd9d1832a29" returned: 0 in 0.295s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-252ad9e5-19b6-4068-9160-acd9d1832a29" released by "_delete_snapshot" :: held 1.778s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b" released by "delete_snapshot" :: held 1.803s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:54 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Created reservations ['a135363f-0051-4e64-8fed-9e921e1087a0', 'c936104a-2ec6-4c9e-8806-54563bf21c60', 'de9837a0-ace1-4ec2-867b-6bb9176939a3', '89be3020-7f70-45ed-9245-44d395bc1ca1'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:54 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Delete snapshot completed successfully. Jul 16 11:20:54 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-6db3a08c-8376-4f94-9a15-e75f48a4c9c1 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-252ad9e5-19b6-4068-9160-acd9d1832a29-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] Creating offline snapshot c67181d2-3f7d-4bc6-862d-6351f4a69592 of volume b4b925fc-e35d-4f0d-8632-e032b992242f {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6239659-61f1-4fc8-886d-e4b60c74b8db]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "cinder-quobyte-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[282728e7-0543-480b-908c-da54773f3d00]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:55 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f Jul 16 11:20:55 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:55 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b Jul 16 11:20:55 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:55 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f" returned: 0 in 0.404s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:55 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 1G Jul 16 11:20:55 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:55 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b" returned: 0 in 0.401s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:55 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b Jul 16 11:20:55 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:55 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b" returned: 0 in 0.301s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:55 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-quobyte-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b" released by "delete_volume" :: held 0.771s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:55 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 1G" returned: 0 in 0.462s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4b925fc-e35d-4f0d-8632-e032b992242f -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Created reservations ['912ea1b3-7b52-42d5-adb9-b63ddeaadca0', '4300cb81-74f0-4ec3-97ea-6821d5d391c3', 'be1e7e8d-7d0a-4584-a519-124fbdceb7f6', 'b4c02e60-ccd9-4bad-87d0-48a407cd8574'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:56 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4b925fc-e35d-4f0d-8632-e032b992242f -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 Jul 16 11:20:56 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:56 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:20:56 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:56 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.317s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:20:56 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Deleted volume successfully. Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-d0c5154f-4ea1-41bb-8699-089b77285d60 tempest-ProjectReaderTests-2042638655 None] Lock "cinder-5ba8c06f-02d5-45eb-a8e4-fe72d13d874b-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:56 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4b925fc-e35d-4f0d-8632-e032b992242f -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592" returned: 0 in 0.511s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:56 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 is being set with open permissions: ugo+rw Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:56 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 Jul 16 11:20:56 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:56 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592" returned: 0 in 0.289s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:56 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:56 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.info Jul 16 11:20:56 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:57 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.info" returned: 0 in 0.259s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:57 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.info is being set with open permissions: ugo+rw Jul 16 11:20:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:57 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.info Jul 16 11:20:57 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:57 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.info" returned: 0 in 0.294s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:57 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:20:57 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-95c407cd-b5ca-4804-9bc9-3b1ef7220701 tempest-ProjectMemberTests-1725097689 None] Create snapshot completed successfully Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-c67181d2-3f7d-4bc6-862d-6351f4a69592-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-c67181d2-3f7d-4bc6-862d-6351f4a69592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-b4b925fc-e35d-4f0d-8632-e032b992242f" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-b4b925fc-e35d-4f0d-8632-e032b992242f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-c67181d2-3f7d-4bc6-862d-6351f4a69592" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-c67181d2-3f7d-4bc6-862d-6351f4a69592" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Deleting offline snapshot c67181d2-3f7d-4bc6-862d-6351f4a69592 of volume b4b925fc-e35d-4f0d-8632-e032b992242f {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] snapshot_file for this snap is: volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[723ab1d1-7d75-4277-923a-cc0b8cdfc51e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:58 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 Jul 16 11:20:58 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:58 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592" returned: 0 in 0.396s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4b925fc-e35d-4f0d-8632-e032b992242f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8f4237-d735-405d-bc81-0f3e7b7fc0ab]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:20:58 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:58 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f Jul 16 11:20:58 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:59 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f" returned: 0 in 0.372s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:59 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 Jul 16 11:20:59 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:59 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592" returned: 0 in 0.376s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:20:59 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592 Jul 16 11:20:59 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:20:59 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 16 11:20:59 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f.c67181d2-3f7d-4bc6-862d-6351f4a69592" returned: 0 in 0.250s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:20:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-c67181d2-3f7d-4bc6-862d-6351f4a69592" released by "_delete_snapshot" :: held 1.518s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-b4b925fc-e35d-4f0d-8632-e032b992242f" released by "delete_snapshot" :: held 1.545s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:20:59 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Created reservations ['17ed4e7f-51ba-44e7-8e67-ad823110b76e', 'a05ec14d-6452-4ecd-be4e-4e8b08e45c8c', 'c78f997f-9609-40d6-b8b5-a7a9e0258980', '0a9931ef-5dad-40ac-9e99-13e70a5523e2'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:20:59 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Delete snapshot completed successfully. Jul 16 11:20:59 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-85b184b3-12c8-4086-9ab5-fc2c17624750 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-c67181d2-3f7d-4bc6-862d-6351f4a69592-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-b4b925fc-e35d-4f0d-8632-e032b992242f-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Lock "cinder-b4b925fc-e35d-4f0d-8632-e032b992242f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-b4b925fc-e35d-4f0d-8632-e032b992242f" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:00 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-b4b925fc-e35d-4f0d-8632-e032b992242f" acquired by "delete_volume" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:00 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65bdcee-9469-4aaf-9854-74d9b04c35e4]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:00 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f Jul 16 11:21:00 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:00 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f" returned: 0 in 0.348s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:00 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:00 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f Jul 16 11:21:00 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:01 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b4b925fc-e35d-4f0d-8632-e032b992242f" returned: 0 in 0.242s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-b4b925fc-e35d-4f0d-8632-e032b992242f" released by "delete_volume" :: held 0.644s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Created reservations ['8547f9dd-ea75-4ca6-b388-0ca73f17ced1', '1e94b6ee-674e-47b3-9df9-70a98e8f1aa6', 'e895aafd-1eb5-4e28-a20e-307ad0dde6d7', '7cb9753e-5d48-4d20-bc47-fd1bcb759dfb'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:01 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:21:01 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:01 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:21:01 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Deleted volume successfully. Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=188,cinder:INSERT=75,cinder:UPDATE=240,cinder:DELETE=22 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:21:01 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-34f94e87-9f76-45a0-985f-7aeb2a74e71a tempest-ProjectMemberTests-1725097689 None] Lock "cinder-b4b925fc-e35d-4f0d-8632-e032b992242f-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (0212eabd-dec3-4135-b069-81956dfb244c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df17e99-9edd-4221-9428-e706ed7a9285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df17e99-9edd-4221-9428-e706ed7a9285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1889841584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cc3f67-9c5b-4d27-9267-c9c54549c4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:02Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a226eb41-36ef-4ae5-825a-0d19769f4ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a226eb41-36ef-4ae5-825a-0d19769f4ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1fd9c6-6dd1-47e7-95c9-ff4a134c8721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1fd9c6-6dd1-47e7-95c9-ff4a134c8721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8cc3f67-9c5b-4d27-9267-c9c54549c4fa', 'volume_name': 'volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba6c989-fcde-403d-bdcb-ad69eee1954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba6c989-fcde-403d-bdcb-ad69eee1954a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8272be8-6c06-4bd6-9b47-4a9b90e87d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:02 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Volume c8cc3f67-9c5b-4d27-9267-c9c54549c4fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa', 'volume_size': 1} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1889841584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cc3f67-9c5b-4d27-9267-c9c54549c4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:02Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Creating volume c8cc3f67-9c5b-4d27-9267-c9c54549c4fa {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:21:02 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:02 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa 1073741824 Jul 16 11:21:02 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:02 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa 1073741824" returned: 0 in 0.394s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=200,cinder:INSERT=61,cinder:UPDATE=253,cinder:DELETE=18 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:02 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa Jul 16 11:21:02 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:02 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa" returned: 0 in 0.249s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8272be8-6c06-4bd6-9b47-4a9b90e87d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90892ab-3fdd-4a02-83bd-96e7dd641549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:02 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Volume volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa (c8cc3f67-9c5b-4d27-9267-c9c54549c4fa): created successfully Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90892ab-3fdd-4a02-83bd-96e7dd641549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:02 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (0212eabd-dec3-4135-b069-81956dfb244c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:02 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-7a4fdc52-39b1-405b-91b8-67f52d0c487c tempest-ProjectMemberTests-1725097689 None] Created volume successfully. Jul 16 11:21:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:03 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] Creating offline snapshot 201d9e48-bba2-4882-8408-e1989e50fd49 of volume c8cc3f67-9c5b-4d27-9267-c9c54549c4fa {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:21:03 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[7643f850-1275-465a-b2d6-d38212bdca76]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:03 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa Jul 16 11:21:03 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:03 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa" returned: 0 in 0.350s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:03 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 1G Jul 16 11:21:03 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:03 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 1G" returned: 0 in 0.378s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:03 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:03 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 Jul 16 11:21:03 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:04 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49" returned: 0 in 0.277s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:04 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 is being set with open permissions: ugo+rw Jul 16 11:21:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:04 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 Jul 16 11:21:04 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:04 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:04 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.info Jul 16 11:21:04 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:04 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.info" returned: 0 in 0.239s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:04 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.info is being set with open permissions: ugo+rw Jul 16 11:21:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:04 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.info Jul 16 11:21:04 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:04 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.info" returned: 0 in 0.229s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:04 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.782s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:05 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-83ea9d0c-264a-4178-a9d7-e9e5aa14c8ac tempest-ProjectMemberTests-1725097689 None] Create snapshot completed successfully Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-201d9e48-bba2-4882-8408-e1989e50fd49-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-201d9e48-bba2-4882-8408-e1989e50fd49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-201d9e48-bba2-4882-8408-e1989e50fd49" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-201d9e48-bba2-4882-8408-e1989e50fd49" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Deleting offline snapshot 201d9e48-bba2-4882-8408-e1989e50fd49 of volume c8cc3f67-9c5b-4d27-9267-c9c54549c4fa {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] snapshot_file for this snap is: volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed86d331-75ee-4f10-bb73-945dc336bf1e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:05 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 Jul 16 11:21:05 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:05 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49" returned: 0 in 0.336s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cd4761-31f4-456a-9803-38d34f2dfb99]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:05 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:05 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa Jul 16 11:21:05 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:06 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa" returned: 0 in 0.340s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:06 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 Jul 16 11:21:06 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:06 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49" returned: 0 in 0.321s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:06 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49 Jul 16 11:21:06 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:06 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:06 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa.201d9e48-bba2-4882-8408-e1989e50fd49" returned: 0 in 0.236s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-201d9e48-bba2-4882-8408-e1989e50fd49" released by "_delete_snapshot" :: held 1.319s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa" released by "delete_snapshot" :: held 1.338s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:06 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Created reservations ['025283a6-a0e4-4fa3-83e5-838376e02d7e', '812843c4-6a24-4e89-b67c-516c4a417be2', 'ad8a23d4-7db9-45d5-be26-f265040189b3', '0472d4b5-8d48-42c6-a48c-93ac584e66a0'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:21:06 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Delete snapshot completed successfully. Jul 16 11:21:06 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-369e3af3-5266-4335-ae90-71bded087115 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-201d9e48-bba2-4882-8408-e1989e50fd49-delete_snapshot" released by "delete_snapshot" :: held 1.463s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:07 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:07 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac23e86-7e92-4a5e-9eb6-736bfd2ee4e3]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:07 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa Jul 16 11:21:07 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:07 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa" returned: 0 in 0.338s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:07 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:07 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa Jul 16 11:21:07 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:08 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa" returned: 0 in 0.232s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa" released by "delete_volume" :: held 0.621s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Created reservations ['f39be4b2-a7ef-4a95-9433-08d207499dfa', '1f37d416-2096-4fba-8f07-b83b78bef76b', '1f711fb2-fca6-4494-b617-66c676e3951d', '7f0a6240-6dfd-4305-839b-4a1f1847c14d'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:08 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:21:08 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:08 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.233s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:21:08 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Deleted volume successfully. Jul 16 11:21:08 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-b32203ad-04e6-43e7-8670-c8e39ab10c89 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-c8cc3f67-9c5b-4d27-9267-c9c54549c4fa-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (eeb7c572-a0f2-49d1-9bff-61a31d3e3822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d40ccb1-365f-4794-9032-4c3441a7d7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d40ccb1-365f-4794-9032-4c3441a7d7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579014268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f3b544-5c63-4cbf-acd3-7a64fdbbb540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:09Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04ac02e-d1bb-4ac8-b2e1-16f1330be553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04ac02e-d1bb-4ac8-b2e1-16f1330be553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a111c1-8c43-4137-a7d3-2f0f5b05abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a111c1-8c43-4137-a7d3-2f0f5b05abe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3f3b544-5c63-4cbf-acd3-7a64fdbbb540', 'volume_name': 'volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03c5cd3-51db-404a-a8e6-7bad2d0e7332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03c5cd3-51db-404a-a8e6-7bad2d0e7332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d3d6d1-d541-425d-9417-d66a3fe4e03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Volume f3f3b544-5c63-4cbf-acd3-7a64fdbbb540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540', 'volume_size': 1} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579014268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f3b544-5c63-4cbf-acd3-7a64fdbbb540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b937f42c4d634b9886ef209524c9f5da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:09Z,use_quota=True,user_id='2b4b48ab978c426d9f8385eb287532e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Creating volume f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:21:09 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:09 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 1073741824 Jul 16 11:21:09 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:09 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 1073741824" returned: 0 in 0.400s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:09 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 Jul 16 11:21:09 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:09 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540" returned: 0 in 0.246s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d3d6d1-d541-425d-9417-d66a3fe4e03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aab1670-d06a-4729-b4c7-ef379db4aa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:09 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Volume volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 (f3f3b544-5c63-4cbf-acd3-7a64fdbbb540): created successfully Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aab1670-d06a-4729-b4c7-ef379db4aa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:09 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Flow 'volume_create_manager' (eeb7c572-a0f2-49d1-9bff-61a31d3e3822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:09 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-22c48580-be0a-4036-a49a-e0aaf3761767 tempest-ProjectMemberTests-1725097689 None] Created volume successfully. Jul 16 11:21:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:10 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] Creating offline snapshot 7b58e5a9-04df-4180-adfd-7392d59b4ab9 of volume f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 {{(pid=87345) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 11:21:10 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[6126c419-6a1e-48f4-906f-8291731106b7]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:10 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 Jul 16 11:21:10 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:10 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540" returned: 0 in 0.351s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 1G {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:10 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 1G Jul 16 11:21:10 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:10 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 1G" returned: 0 in 0.384s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:10 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:11 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 Jul 16 11:21:11 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:11 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 -F qcow2 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9" returned: 0 in 0.286s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:11 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 is being set with open permissions: ugo+rw Jul 16 11:21:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:11 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 Jul 16 11:21:11 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:11 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9" returned: 0 in 0.233s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:11 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.info Jul 16 11:21:11 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:11 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.info" returned: 0 in 0.252s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:11 devstack cinder-volume[87345]: WARNING cinder.volume.drivers.remotefs [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.info is being set with open permissions: ugo+rw Jul 16 11:21:11 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.info {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:11 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.info Jul 16 11:21:11 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:12 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.info" returned: 0 in 0.230s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:12 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-61c15977-6717-4f74-ba46-5426264c5e99 tempest-ProjectMemberTests-1725097689 None] Create snapshot completed successfully Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-7b58e5a9-04df-4180-adfd-7392d59b4ab9-delete_snapshot" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Lock "cinder-7b58e5a9-04df-4180-adfd-7392d59b4ab9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540" by "delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-7b58e5a9-04df-4180-adfd-7392d59b4ab9" by "_delete_snapshot" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-7b58e5a9-04df-4180-adfd-7392d59b4ab9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Deleting offline snapshot 7b58e5a9-04df-4180-adfd-7392d59b4ab9 of volume f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] snapshot_file for this snap is: volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 {{(pid=87345) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ca1ad1-5cfd-41cd-a947-0cb7f034faba]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:12 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 Jul 16 11:21:12 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:12 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9" returned: 0 in 0.337s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87345) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[572ab66c-6c3b-4c17-bbb9-d8652e58bfe9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:12 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:12 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 Jul 16 11:21:12 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:13 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540" returned: 0 in 0.336s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:13 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 Jul 16 11:21:13 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:13 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9" returned: 0 in 0.325s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:13 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9 Jul 16 11:21:13 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:13 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:13 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540.7b58e5a9-04df-4180-adfd-7392d59b4ab9" returned: 0 in 0.242s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-7b58e5a9-04df-4180-adfd-7392d59b4ab9" released by "_delete_snapshot" :: held 1.327s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540" released by "delete_snapshot" :: held 1.347s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:13 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Created reservations ['e0c51b52-e6af-4795-9cd5-166578f6223c', 'a6bb223a-8c59-48a9-bb1d-770987467af9', '7e09365e-b503-48bc-81a5-0319303b2656', '0cc0173b-ebac-4776-8ba1-4b48337a6a2c'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:21:13 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Delete snapshot completed successfully. Jul 16 11:21:13 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-023b5a00-aee8-4d22-8fa2-88b87478ba3f tempest-ProjectMemberTests-1725097689 None] Lock "cinder-7b58e5a9-04df-4180-adfd-7392d59b4ab9-delete_snapshot" released by "delete_snapshot" :: held 1.483s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "cinder-quobyte-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:14 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540" acquired by "delete_volume" :: waited 0.015s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:14 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[28452dfa-f369-4574-b85b-76b0b2e30158]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:14 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:14 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 Jul 16 11:21:14 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:15 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540" returned: 0 in 0.343s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:15 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540 Jul 16 11:21:15 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:15 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540" returned: 0 in 0.236s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-quobyte-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540" released by "delete_volume" :: held 0.632s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Created reservations ['4792df79-a820-4af6-89e7-ea52c730e6ec', '56e68e5f-c1a9-4116-be30-1f1a0e4013f8', 'f3c9d5a9-d18e-4948-9237-1c070457076b', '424f2f23-ce6a-4f0a-8ed5-69ff207d54e9'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:15 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:21:15 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:15 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.239s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:21:15 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Deleted volume successfully. Jul 16 11:21:15 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-23a8fc23-4a73-40ca-9023-74007006c924 tempest-ProjectMemberTests-1725097689 None] Lock "cinder-f3f3b544-5c63-4cbf-acd3-7a64fdbbb540-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Flow 'volume_create_manager' (c6f4dce0-0f09-4212-bcd8-4b3568f1138b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae40b16e-b6e1-41a2-8fe4-e512b5351b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae40b16e-b6e1-41a2-8fe4-e512b5351b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-702309417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9958710-e1e3-4eaa-a5f7-6abbc725dc61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda02ba4cfe14409a6773c12ad507c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:19Z,use_quota=True,user_id='1821d0c85baa4de8b6e5f3c6297f9dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97533b3-e1f1-4869-8457-3e9d979a21d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97533b3-e1f1-4869-8457-3e9d979a21d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b65de0-e893-441f-a04d-da95f1cb97f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b65de0-e893-441f-a04d-da95f1cb97f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9958710-e1e3-4eaa-a5f7-6abbc725dc61', 'volume_name': 'volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a760410b-33b4-40e0-bf77-7d709684e6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a760410b-33b4-40e0-bf77-7d709684e6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb255c5-3790-482b-911f-14e28ec3160a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:19 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Volume b9958710-e1e3-4eaa-a5f7-6abbc725dc61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61', 'volume_size': 1} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-702309417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9958710-e1e3-4eaa-a5f7-6abbc725dc61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda02ba4cfe14409a6773c12ad507c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:19Z,use_quota=True,user_id='1821d0c85baa4de8b6e5f3c6297f9dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Creating volume b9958710-e1e3-4eaa-a5f7-6abbc725dc61 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:21:19 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:19 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61 1073741824 Jul 16 11:21:19 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:19 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61 1073741824" returned: 0 in 0.416s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:19 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:19 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61 Jul 16 11:21:19 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:20 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61" returned: 0 in 0.240s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb255c5-3790-482b-911f-14e28ec3160a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab87259-f09a-4b57-8974-441d18d75e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:20 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Volume volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61 (b9958710-e1e3-4eaa-a5f7-6abbc725dc61): created successfully Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab87259-f09a-4b57-8974-441d18d75e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Flow 'volume_create_manager' (c6f4dce0-0f09-4212-bcd8-4b3568f1138b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:20 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4e3ff225-805f-4db9-a719-0af53ce49016 tempest-ProjectReaderTests-1937103270 None] Created volume successfully. Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Acquiring lock "cinder-b9958710-e1e3-4eaa-a5f7-6abbc725dc61-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Lock "cinder-b9958710-e1e3-4eaa-a5f7-6abbc725dc61-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Acquiring lock "cinder-quobyte-b9958710-e1e3-4eaa-a5f7-6abbc725dc61" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Lock "cinder-quobyte-b9958710-e1e3-4eaa-a5f7-6abbc725dc61" acquired by "delete_volume" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b89c2fd-ccc1-47e2-acfa-b7304fc79af4]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:20 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61 Jul 16 11:21:20 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:20 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61" returned: 0 in 0.341s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:20 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:20 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61 Jul 16 11:21:20 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:21 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-b9958710-e1e3-4eaa-a5f7-6abbc725dc61" returned: 0 in 0.234s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Lock "cinder-quobyte-b9958710-e1e3-4eaa-a5f7-6abbc725dc61" released by "delete_volume" :: held 0.611s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Created reservations ['5e9adc6a-bad8-4b7e-9e89-854cb776b331', 'a84d88b4-8557-48df-be1e-e9d09498d6cd', '1ee958f6-91df-4020-803a-05a02f2fe343', '4c78394f-005d-4554-b972-ba1f665a6725'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:21 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:21:21 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:21 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:21:21 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Deleted volume successfully. Jul 16 11:21:21 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3f7fe965-76da-4612-b119-fe29e459c7cd tempest-ProjectReaderTests-1937103270 None] Lock "cinder-b9958710-e1e3-4eaa-a5f7-6abbc725dc61-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Flow 'volume_create_manager' (4d7780ee-b340-4d13-95f8-5123b9a65c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ce6036-b83c-40fb-a337-8ff2513f662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ce6036-b83c-40fb-a337-8ff2513f662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30152189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2436c6-0ef7-4c29-a1ae-2383a23853a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda02ba4cfe14409a6773c12ad507c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:22Z,use_quota=True,user_id='1821d0c85baa4de8b6e5f3c6297f9dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e60ab3-4c32-44a9-9cdb-318e71ab8daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e60ab3-4c32-44a9-9cdb-318e71ab8daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e876cabb-6a0e-41e8-921d-b782cd416bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e876cabb-6a0e-41e8-921d-b782cd416bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2436c6-0ef7-4c29-a1ae-2383a23853a3', 'volume_name': 'volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a67c8e9-2b72-4ee0-baad-98845d4c58e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a67c8e9-2b72-4ee0-baad-98845d4c58e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889459f2-ee28-4392-9142-c3cea0e05eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:22 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Volume 0c2436c6-0ef7-4c29-a1ae-2383a23853a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3', 'volume_size': 1} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-30152189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2436c6-0ef7-4c29-a1ae-2383a23853a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda02ba4cfe14409a6773c12ad507c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:22Z,use_quota=True,user_id='1821d0c85baa4de8b6e5f3c6297f9dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Creating volume 0c2436c6-0ef7-4c29-a1ae-2383a23853a3 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:21:22 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:22 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3 1073741824 Jul 16 11:21:22 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:22 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3 1073741824" returned: 0 in 0.395s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:22 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3 Jul 16 11:21:22 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:22 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3" returned: 0 in 0.235s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (889459f2-ee28-4392-9142-c3cea0e05eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff00b30-2e99-47e8-aa37-e7cc781a264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:22 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Volume volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3 (0c2436c6-0ef7-4c29-a1ae-2383a23853a3): created successfully Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff00b30-2e99-47e8-aa37-e7cc781a264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:22 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Flow 'volume_create_manager' (4d7780ee-b340-4d13-95f8-5123b9a65c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:22 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-03adb7e0-a63e-4169-a946-1465729fa824 tempest-ProjectReaderTests-1937103270 None] Created volume successfully. Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Acquiring lock "cinder-0c2436c6-0ef7-4c29-a1ae-2383a23853a3-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Lock "cinder-0c2436c6-0ef7-4c29-a1ae-2383a23853a3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Acquiring lock "cinder-quobyte-0c2436c6-0ef7-4c29-a1ae-2383a23853a3" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Lock "cinder-quobyte-0c2436c6-0ef7-4c29-a1ae-2383a23853a3" acquired by "delete_volume" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1545377e-68f1-44fd-a1cb-24d491c5444e]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:23 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3 Jul 16 11:21:23 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:23 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:23 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3 Jul 16 11:21:23 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:23 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-0c2436c6-0ef7-4c29-a1ae-2383a23853a3" returned: 0 in 0.234s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Lock "cinder-quobyte-0c2436c6-0ef7-4c29-a1ae-2383a23853a3" released by "delete_volume" :: held 0.618s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Created reservations ['f1a5d9bb-1ba6-4af9-8bda-3efc43ee4c6d', '05afd7d0-53f4-42b9-a3f2-e1819d854133', '08cd5687-e322-4fdb-881e-5a3962bd50b8', '9c23fdfd-cf41-4b76-837b-55be12bc05c8'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:23 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:23 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:21:23 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:24 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:24 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.235s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:24 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:21:24 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Deleted volume successfully. Jul 16 11:21:24 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-11b49850-9750-49b5-8e4e-8755ce69a990 tempest-ProjectReaderTests-1937103270 None] Lock "cinder-0c2436c6-0ef7-4c29-a1ae-2383a23853a3-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Flow 'volume_create_manager' (ede35485-b881-4470-b366-1dae29615486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad8a805-13f8-4a88-b1d5-984b5c0336df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad8a805-13f8-4a88-b1d5-984b5c0336df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672581809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d8cc2a-b2ee-4eb8-9d53-5dbca190d136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4d09e27c744417b829e21cf234e879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:27Z,use_quota=True,user_id='206990b05bd5476db54ac1de80e52b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e9fc8c-9c29-4ff1-a0e4-526307024619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e9fc8c-9c29-4ff1-a0e4-526307024619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c48525-287f-49ea-a8ef-479d724437e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c48525-287f-49ea-a8ef-479d724437e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d8cc2a-b2ee-4eb8-9d53-5dbca190d136', 'volume_name': 'volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41712ca6-0ec6-4381-bb55-02ab2a8bd972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41712ca6-0ec6-4381-bb55-02ab2a8bd972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896f1e17-f621-45f9-9e88-dc763036b758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:27 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Volume 33d8cc2a-b2ee-4eb8-9d53-5dbca190d136: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136', 'volume_size': 1} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672581809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d8cc2a-b2ee-4eb8-9d53-5dbca190d136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4d09e27c744417b829e21cf234e879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:27Z,use_quota=True,user_id='206990b05bd5476db54ac1de80e52b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Creating volume 33d8cc2a-b2ee-4eb8-9d53-5dbca190d136 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:21:27 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:27 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136 1073741824 Jul 16 11:21:27 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:27 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:27 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136 1073741824" returned: 0 in 0.403s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:28 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136 Jul 16 11:21:28 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:28 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136" returned: 0 in 0.237s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896f1e17-f621-45f9-9e88-dc763036b758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b3d5bc-33ce-41b0-9b24-6f9760372e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:28 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Volume volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136 (33d8cc2a-b2ee-4eb8-9d53-5dbca190d136): created successfully Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b3d5bc-33ce-41b0-9b24-6f9760372e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Flow 'volume_create_manager' (ede35485-b881-4470-b366-1dae29615486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:28 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-205b7428-f37e-4bb7-a257-9b43dd170a38 tempest-ProjectReaderTests-648425387 None] Created volume successfully. Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Acquiring lock "cinder-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Lock "cinder-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Acquiring lock "cinder-quobyte-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Lock "cinder-quobyte-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136" acquired by "delete_volume" :: waited 0.013s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07fc910-fa49-4d80-aa2c-ee08ff0e818c]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:28 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:28 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136 Jul 16 11:21:28 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:29 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136" returned: 0 in 0.351s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:29 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136 Jul 16 11:21:29 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:29 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136" returned: 0 in 0.260s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Lock "cinder-quobyte-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136" released by "delete_volume" :: held 0.648s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Created reservations ['6bad52d7-b25d-4de6-b813-84832d0d00af', '0531888b-025c-445e-ac85-05bb185af500', 'c209e904-0e84-4f2f-bc1e-4c136386a72a', 'a8055c73-0676-42d4-91ff-7deb292f58a2'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:29 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:21:29 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:29 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.237s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:21:29 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Deleted volume successfully. Jul 16 11:21:29 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-4a10af39-67b0-483e-a815-beef2ff7fc83 tempest-ProjectReaderTests-648425387 None] Lock "cinder-33d8cc2a-b2ee-4eb8-9d53-5dbca190d136-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Flow 'volume_create_manager' (94db39e2-9dc3-401d-a072-7783da827fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013ed545-83f9-4b94-a6dc-62c708634816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013ed545-83f9-4b94-a6dc-62c708634816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485597782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901f827b-d312-4da9-967a-e6b9c44adea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4d09e27c744417b829e21cf234e879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:30Z,use_quota=True,user_id='206990b05bd5476db54ac1de80e52b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708ca756-7e99-4e90-8bf7-54890c4adf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708ca756-7e99-4e90-8bf7-54890c4adf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3865d3f3-65c4-4a94-8a3d-41c169bfb982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3865d3f3-65c4-4a94-8a3d-41c169bfb982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '901f827b-d312-4da9-967a-e6b9c44adea2', 'volume_name': 'volume-901f827b-d312-4da9-967a-e6b9c44adea2', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c90b1a4-e53f-484a-a840-d4563afc9d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c90b1a4-e53f-484a-a840-d4563afc9d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7404da4-dc47-4c95-8d21-95b3085f1483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:30 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Volume 901f827b-d312-4da9-967a-e6b9c44adea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-901f827b-d312-4da9-967a-e6b9c44adea2', 'volume_size': 1} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485597782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901f827b-d312-4da9-967a-e6b9c44adea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4d09e27c744417b829e21cf234e879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:30Z,use_quota=True,user_id='206990b05bd5476db54ac1de80e52b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Creating volume 901f827b-d312-4da9-967a-e6b9c44adea2 {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:21:30 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:30 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2 1073741824 Jul 16 11:21:30 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:30 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2 1073741824" returned: 0 in 0.402s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:30 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2 Jul 16 11:21:30 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:30 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2" returned: 0 in 0.239s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7404da4-dc47-4c95-8d21-95b3085f1483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901f827b-d312-4da9-967a-e6b9c44adea2', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb1ce51-bc97-4b37-9a7f-6c7fcd954f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:30 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Volume volume-901f827b-d312-4da9-967a-e6b9c44adea2 (901f827b-d312-4da9-967a-e6b9c44adea2): created successfully Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb1ce51-bc97-4b37-9a7f-6c7fcd954f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:30 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Flow 'volume_create_manager' (94db39e2-9dc3-401d-a072-7783da827fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:31 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-12caeaae-252c-4192-8cf4-bd41c13e65d6 tempest-ProjectReaderTests-648425387 None] Created volume successfully. Jul 16 11:21:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Acquiring lock "cinder-901f827b-d312-4da9-967a-e6b9c44adea2-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Lock "cinder-901f827b-d312-4da9-967a-e6b9c44adea2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Acquiring lock "cinder-quobyte-901f827b-d312-4da9-967a-e6b9c44adea2" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Lock "cinder-quobyte-901f827b-d312-4da9-967a-e6b9c44adea2" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:31 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b69e9e-ee4f-4bee-9406-3543a33c83c7]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:31 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2 Jul 16 11:21:31 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:31 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:31 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2 Jul 16 11:21:31 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:31 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:31 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-901f827b-d312-4da9-967a-e6b9c44adea2" returned: 0 in 0.237s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:31 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Lock "cinder-quobyte-901f827b-d312-4da9-967a-e6b9c44adea2" released by "delete_volume" :: held 0.616s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:31 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Created reservations ['a4cbf8b7-9812-46c2-b1b6-9c77faf43c1c', 'a6c1a7c9-d2b7-4565-b6bd-5f42438cb050', 'daeed0bd-b76f-4854-8f2b-4857b809136c', 'bab694e0-2621-43bb-b9c6-f52e6ac4a8b7'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:32 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:21:32 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:32 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.242s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:21:32 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Deleted volume successfully. Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-3b8bfe3f-4c33-4367-a46a-dca920b85e15 tempest-ProjectReaderTests-648425387 None] Lock "cinder-901f827b-d312-4da9-967a-e6b9c44adea2-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Flow 'volume_create_manager' (267603e7-9661-47f5-b330-668480561f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7ab4f9-f678-45d1-baaa-b1ee088a8470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7ab4f9-f678-45d1-baaa-b1ee088a8470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231340395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e8d5b7-3483-465e-976e-892aa921abac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4d09e27c744417b829e21cf234e879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:33Z,use_quota=True,user_id='206990b05bd5476db54ac1de80e52b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb799f84-a8b6-4746-9c25-c4086c38f0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb799f84-a8b6-4746-9c25-c4086c38f0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedcab25-6027-4d15-831e-6b3d6a6306a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fedcab25-6027-4d15-831e-6b3d6a6306a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e8d5b7-3483-465e-976e-892aa921abac', 'volume_name': 'volume-48e8d5b7-3483-465e-976e-892aa921abac', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d57afb-abb0-4cef-95e1-5d5839a008c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d57afb-abb0-4cef-95e1-5d5839a008c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3476d823-5a44-496f-aaf6-3b0e6c12d858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:32 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Volume 48e8d5b7-3483-465e-976e-892aa921abac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e8d5b7-3483-465e-976e-892aa921abac', 'volume_size': 1} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231340395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e8d5b7-3483-465e-976e-892aa921abac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4d09e27c744417b829e21cf234e879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:33Z,use_quota=True,user_id='206990b05bd5476db54ac1de80e52b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Creating volume 48e8d5b7-3483-465e-976e-892aa921abac {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:21:32 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:21:32 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:32 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac 1073741824 Jul 16 11:21:32 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:33 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac 1073741824" returned: 0 in 0.409s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:33 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac Jul 16 11:21:33 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:33 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac" returned: 0 in 0.232s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3476d823-5a44-496f-aaf6-3b0e6c12d858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e8d5b7-3483-465e-976e-892aa921abac', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e6a416-62ab-4b7b-b42b-dad907209300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:33 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Volume volume-48e8d5b7-3483-465e-976e-892aa921abac (48e8d5b7-3483-465e-976e-892aa921abac): created successfully Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e6a416-62ab-4b7b-b42b-dad907209300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Flow 'volume_create_manager' (267603e7-9661-47f5-b330-668480561f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:33 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-bcf05108-2c0a-499f-acb2-5df485a6fe83 tempest-ProjectReaderTests-648425387 None] Created volume successfully. Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Acquiring lock "cinder-48e8d5b7-3483-465e-976e-892aa921abac-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Lock "cinder-48e8d5b7-3483-465e-976e-892aa921abac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Acquiring lock "cinder-quobyte-48e8d5b7-3483-465e-976e-892aa921abac" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Lock "cinder-quobyte-48e8d5b7-3483-465e-976e-892aa921abac" acquired by "delete_volume" :: waited 0.014s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[1087aa44-604f-4c53-8e25-93298052e7a9]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:33 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:34 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac Jul 16 11:21:34 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:34 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac" returned: 0 in 0.342s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:34 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac Jul 16 11:21:34 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:34 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-48e8d5b7-3483-465e-976e-892aa921abac" returned: 0 in 0.236s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Lock "cinder-quobyte-48e8d5b7-3483-465e-976e-892aa921abac" released by "delete_volume" :: held 0.614s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Created reservations ['90f93de2-e04f-4f1c-bb65-62c58a3c26e1', '58dc865d-9ca4-42c9-b753-e047f08d29d4', '22c2c642-1e22-41c5-9ba4-d34e2a93eaaf', 'b2e1150c-0497-43f9-852b-9e18bebb89ff'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:34 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:21:34 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:34 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:21:34 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:34 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.238s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_service.periodic_task [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] Running periodic task VolumeManager._thread_info {{(pid=87345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 11:21:34 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread count: 28 {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-bab10adc-4781-4e6b-98e9-ee0860e57822 None None] thread info: [<_MainThread(MainThread, started 124249531777152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87345) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.234s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:21:34 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Deleted volume successfully. Jul 16 11:21:34 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-5480df8b-ce78-4746-90e6-f19e46e77c17 tempest-ProjectReaderTests-648425387 None] Lock "cinder-48e8d5b7-3483-465e-976e-892aa921abac-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.flows.manager.create_volume [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87345) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Flow 'volume_create_manager' (efe6ce8d-d657-41fc-b679-9fa980526f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b78cf91-ed8a-4e37-935b-8b388eb2a094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b78cf91-ed8a-4e37-935b-8b388eb2a094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039009150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ff146f-978a-4346-aae0-bbbd566c6ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4d09e27c744417b829e21cf234e879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:35Z,use_quota=True,user_id='206990b05bd5476db54ac1de80e52b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ed84eb-53d6-4e3a-8e5e-2eb4d7f76c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ed84eb-53d6-4e3a-8e5e-2eb4d7f76c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c185102f-4b70-4115-b939-45e5b89719bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c185102f-4b70-4115-b939-45e5b89719bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ff146f-978a-4346-aae0-bbbd566c6ceb', 'volume_name': 'volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80a6c2a-885a-4fe1-8065-2074e284a5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80a6c2a-885a-4fe1-8065-2074e284a5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401efe06-7298-4d67-ad19-5970a6c80ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:35 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Volume f0ff146f-978a-4346-aae0-bbbd566c6ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb', 'volume_size': 1} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T09:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039009150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ff146f-978a-4346-aae0-bbbd566c6ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4d09e27c744417b829e21cf234e879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T09:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T09:21:35Z,use_quota=True,user_id='206990b05bd5476db54ac1de80e52b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a88d4594-c48d-4898-80ca-4674cc2b586c),volume_type_id=a88d4594-c48d-4898-80ca-4674cc2b586c)}" {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.remotefs [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Creating volume f0ff146f-978a-4346-aae0-bbbd566c6ceb {{(pid=87345) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Selected osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 as target Quobyte volume. {{(pid=87345) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 11:21:35 devstack cinder-volume[87345]: INFO cinder.volume.drivers.remotefs [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] casted to osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20 Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb 1073741824 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:35 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb 1073741824 Jul 16 11:21:35 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:35 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb 1073741824" returned: 0 in 0.402s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:35 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:35 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb Jul 16 11:21:35 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:36 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb" returned: 0 in 0.240s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'} {{(pid=87345) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401efe06-7298-4d67-ad19-5970a6c80ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb', 'volume_size': 1}' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9517c24-d0ca-4621-baf3-2e792304a342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 11:21:36 devstack cinder-volume[87345]: INFO cinder.volume.flows.manager.create_volume [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Volume volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb (f0ff146f-978a-4346-aae0-bbbd566c6ceb): created successfully Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9517c24-d0ca-4621-baf3-2e792304a342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87345) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Flow 'volume_create_manager' (efe6ce8d-d657-41fc-b679-9fa980526f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87345) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 11:21:36 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-553934ab-4d89-405a-accb-069831500adc tempest-ProjectReaderTests-648425387 None] Created volume successfully. Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Acquiring lock "cinder-f0ff146f-978a-4346-aae0-bbbd566c6ceb-delete_volume" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Lock "cinder-f0ff146f-978a-4346-aae0-bbbd566c6ceb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Acquiring lock "cinder-quobyte-f0ff146f-978a-4346-aae0-bbbd566c6ceb" by "delete_volume" {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Lock "cinder-quobyte-f0ff146f-978a-4346-aae0-bbbd566c6ceb" acquired by "delete_volume" :: waited 0.016s {{(pid=87345) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG oslo.privsep.daemon [-] privsep: reply[429e49bc-92b3-43c7-a765-e010213c42f7]: (4, 'qcow2') {{(pid=88904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:36 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb Jul 16 11:21:36 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:36 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb" returned: 0 in 0.344s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:36 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:36 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb Jul 16 11:21:36 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:37 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88/volume-f0ff146f-978a-4346-aae0-bbbd566c6ceb" returned: 0 in 0.240s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Lock "cinder-quobyte-f0ff146f-978a-4346-aae0-bbbd566c6ceb" released by "delete_volume" :: held 0.623s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG cinder.quota [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Created reservations ['6882572b-11a7-4986-b7c8-a93e5c8596b2', 'fd7dec7d-c065-444c-9554-0b0a40578777', '0c7104f3-b882-475f-9dfc-6a4d16b10b28', '0ae56933-4df5-49dd-bfc2-43a06b9d86f4'] {{(pid=87345) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20': None} {{(pid=87345) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG cinder.volume.drivers.quobyte [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba4395af-d981-4f6c-88ae-21e504e43a20'] {{(pid=87345) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.lockutils [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87345) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 11:21:37 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88 Jul 16 11:21:37 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 11:21:37 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG oslo_concurrency.processutils [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e8630298ba80be307748748a0e995b88" returned: 0 in 0.241s {{(pid=87345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG cinder.manager [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Notifying Schedulers of capabilities ... {{(pid=87345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 11:21:37 devstack cinder-volume[87345]: INFO cinder.volume.manager [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Deleted volume successfully. Jul 16 11:21:37 devstack cinder-volume[87345]: DEBUG cinder.coordination [None req-690a5a7d-5f0e-484e-852b-27c01cb6e787 tempest-ProjectReaderTests-648425387 None] Lock "cinder-f0ff146f-978a-4346-aae0-bbbd566c6ceb-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87345) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 11:21:47 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:SELECT=76,cinder:UPDATE=95,cinder:INSERT=31,cinder:DELETE=5 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 11:21:49 devstack cinder-volume[87345]: DEBUG dbcounter [-] [87345] Writing DB stats cinder:UPDATE=110,cinder:SELECT=64,cinder:DELETE=13,cinder:INSERT=19 {{(pid=87345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}